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MAUD- AN INTERACTIVE-. e5t*UTER PRdGRAM__FDE THE STRUCTDRING , . DECOMP^jTiOH , 
RE&MPOSITION OF PREFERENCES BETWEEN MUtTIAriRlBOTED ALTERNATIVES ^ 



BRIEF 



Requirement: 

TO suranarize the rationile , user proceaures , and program^ description and 
provide a^?J^are program listing for the Multiattribute Utility Dscon^osx- 
tion (maud) decision aid. - ^ 



Procediire : 



^hs- MADD software was developed as a demon5tratxon^of^the ^plxca|xon^ 
of heuristic devices to deci^ioh-theoretic techniques; bacKground.s provided 
in Tr'542, "Structuring Decisions: The Rble bf Structuring Heurxstxcs. 



Findings : ' - 

This repdrt contains a complete user manual. for the operation of the 
MAUD program^mplemented on the IBM 51 10 : versions are avaxlabls on both tap^ 
Srd?s?ette. 4veral exan.ples are provided_to_h6lp the user both_un4erstana . 
the input and- interpret the : outputs _;._aecision-theoretxc ratxonale^for ^e,. 
: MAUD- algorithms with special _rafercnce to multiattrxbuteutxlxt^^theory as 
well as the prograiitming logic and- operatxons , xs summarized. Fxnally, a com 
plete lins-by-line pjrogram listing^'is included. , 

- " * ' - " ' 

Utilization of Findings: ' ' : ' , 

. " The MAUD program is intended to lupport any decision or choice prpbl em 
that •can.i^e . decomposed into component parts or factors an^ for whxch the 

mak^r choose among alternatives for_any problem; that ^= - f J"^ ' 

allowing users to define, the problem specifics. MAUD would ^ 
helpful in teaching students -a v^iety of military _decxsxon problems to pro 
duce decisions ind be more cognizant of their own values.. 



MAUD- m INTERACTIVE CbMPUTER_PROGRAM FOR THE STRUCTURING, DEC0>^OSITlbN', 
RECOMPOSITlbia OF PREFERENCES BETWEEN MUIiT I ATTRIBUTED ALTERNATIVE:: 
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MAUD- AN INTERACTivE COMPUTER PROiR^^.FOR.THE. STRUCTURING^DECOMPOSIT^ 

IcoSs&^ION OF PREFERENCES BET%?EEN MO I ATTRIBUTED ALTERI^ATI.VEB ' 

• ' • I ' 1/ OVERVIEW . ' ; 



:.This "report describes the use and operation of Multiattribute Uti-li'ty 
Decdtn^dSttT;:; (MAUDf; an, interactive cbmpute.r program for the^struct^^^^ 
dec9€os.ti,9n , . ^d recompositiSn of preferences between multiattrabuted 
Alternatives. — . ' : ' . , : 

^ ■ KmD is designed as a decision, aid , aiding the decision m^c-er in^ariy 
..^d all of rhe above operations.. MAUD is of use in_situations where the 
user has an intuitive ^eel" ^3-^ relevant aspects of_the decxsxon-making situ- 
ation i^d-probllm, but has not as yet urtcd^er.d its prec.se wdrth structure, , 
or whe-re J are interested in_hOW the user's idibsyncratic worth- structure _ 
is mapped onto the problem situation. ; ^ 

• MAUD aiso finds it^ application^ Within systems ^-^^^^^l^'l^^^ 
at a macro llvel/that is, -^hen^ overall act-event_ tree or,utxlity ^^^^^f^ 
!s:Snown-, but where the worth structur^ associated with particular utiUty 
^ ;:sS°^C«ts to be inserted at d^fined&int.^withxn the m.i,. system^needs in- 
vestigation. In this case, MAUD does not address the .decision problem as a 
whole but is used as a tool investigating the j microstructure of a component . 
of the decomposition problem. > _ 

MAVb is designed "for direct interfacing of client (decision maker , ex- 
pi^)^d decision problems in a "hands on" approach. As such, .it^ is designed 
to- interact directly with the client, without using a decision analyst or _ 
technician as 'an interfnediary . The 'decision analyst, dn discu..ing_the prob- 
S wfS the client .before using, MAUD, will wish to arrive at an agreed defi- 
nition^ of the set Of alternatives, whose WdrthUtractureMA^JD is to -investigate 
Sna the goal-unc^^r which the Worth_.tracture is -subsumed ^^^^^'^^ 
issues have been defined, the decision analyst is ; advised_ to let MAUa take^ 
ovJr! str.ucturihg decomposition _ and recomposition of preferences between the , 
alternatives i-n direct interaction -with the user- . ' 

- MAUD produce s'T'iog of. the session that_insues,\ana the decision ana- _ 
lyst may w^ll wish to assume a -foreground rdle again. in 'conducting a^debri-f-. 
ing interview with the client at the end of the session to disousfe the 
,mate-rKl in the log. Tft. log will include the ^yO-composed^lxstic prefer-, 
ence values fdr the alternatives under consideration and -a piimmary of the 
structure 'and-basis on which these values were computed. . , 

MAUD -^so-alAws updates. ife current slfecture elict^d from the^ us^r. 
togetherVith all rel^'vant content, may be saved on a -named file^a^^d recalled 
■ on any sobse<iuent .MAUD run.' The user • then ..has the options of ^rnodif> m^^the^ 
structure, changing content within structure" and simulating the effects o|^_ 
ch-anging vaiue/wlse_ importance weights Within the orxgxnal or modified 



•■•An example of sUdh a log" is . given jsn. pages 10-12 and 15-1/; 

• ■ ■■ ■ /' ^ . ; 



structure. Hence MAUD ran be used for exploring, hypotheses atoou^^new and 

- - - ' - „=h=i-i-;,r, S-i-fferent users' assessments withm a 

hypothetical, alternatives, simulating dXtterent users^ a H•ffpr^>n•t 

cok.n structure, exploring the effecti of -mapping value^_ onto 

worth structures, conducting general sensitivity analy^ses, and so on. 

' ' " Organization of the Report . n 

Section 2 -is 'for the user. It is self-contai^d_ and written-in non^ ^ 
technical l^guage. It may be sep^^ated from ^^^-^^-^^^^f^l^^ 
Ts a usefs manual! It does not issume (dr pEbvidel any technical knowledge 
of decision theory, €:omputer prbgrasaning ,^ or computer operation. . 

. qectidn 3 is- for the decision theorist and decision analyst who_ would 
•XiL^ toTnow io^tllng of thi th.bty underlying MAUB,. suc| a J^Why ^UO^d^ . 

whtat it does, how it does it, and:how 'iecideg^when tp do it^_It also 
■places MAUD in context within general Multiattribute Utility Theory (MAVTJ 
and sugges-ts farther deve lopiqent . v, ^ - ■ • 

Appendii A is foVthe systems analyst' wishing to .implement oy modify 
mm Srai: IBM?5110, North Star Hor^izon , o^-^- ^-^-^ ^^g^^^^Tf "ufee 
The descrip.ti^n o« the MUDj suite of programs '^^fJ^'^^^'f^^^^^li^ 
to the deci^iS^. analyst wishing to know .about the detailed ■ 
MAUD.-' MAUD is modular, and-^o the_ modules --^ ^.e revised, extended and 
sUpplanteiby a decision analyst *ftio is?,_ of has, a good systems programmer 
to -'•tuna" the system to meet particular needs. ^ 
; Appehdix B is a cpmp].lte listing of ' MAUD as' we' .implemented it for the , 
IpM 5110. ' ^ . • • ■" ^ • . ' " ■ \^ 

' ; ' / ' ' P ■■ ■ 

.2. MAUD 'USER '^S MAJlORE 

- The version of Multi'attriiute utility Deco^mpositidn; (MAUD) described 
-here ^ for K IBM SllO" system. _ Intiractidn_ with the user is _=^"-f_°f 

• Ssing thf sbreen for display. ■ MAUD is fflade up of three interrelated prp- . 
graS, s-tored on- a _ 3M ta^ c.rtr'idge that runs on the tape un.t, which is 
an integral part of the 53:10. • , ■ - 0 ' ■ > 

•^•'to run MAUe, 'place' the MAUD^ape cartridge in the slor in the 5110 

* front panel, and type-: ' • :. 1 



; ■ ■ - LOAD! <E>3CUTE> 

i then ■ , J_ ' /: * 



■ j <EXE'CUtE> 
Whatvj^UD DOt^ 



2-1 MAUD vSli initially asR the User for a title for 1:>ie session and- 
3 ae'nerid name for all items :( choice alternatives) under, consideration. _ 
Len^Jnts S allowed: >me following examples _ar. taken^ from a MAUD session 
SSTSpSgn planner ; iFr^ces) in an advertising agency who" had to choose 



one' of, fo'ur viBeotaped prototype advertisements for development and trans- 
mission, over 'the^_coiiuTiercial television network. . ■ 



o 
o 
o 
■ o 



Pleaii type_ in a hai^ for this session FRAN£ES SECOND SESSION 
O.K. ' ■ .. — 

Please type in" a word des-ribirig the topic you want- to 
make a decision about ^by ahsoering the question • ■ 

"The alternatives '1 am thinking about could all be . 
described as CQtA ABS ■ 

Now in singular form: Each alternative could be . 

described . as a COLA; - r '-.a or-? 

Are you reasonably happy with the uords yoa typedf YES . 



o 

Q 
0 
O 



■ ■in this" and the following exaiif.les, the tex-- has beeiT copied from the 
5110's screen, and underliT.es have been added to the user's responses. 

2.*3 The* user, is asked to specify ^choice alterha-tives (a minimum of 3 
items, a maximum of 11).^ F.or ;example ' ; 



o 



^ ^ _ _ _ _ 

F*iease type in the name of a COLA 



you want to consider 

- / 

__ _ ' 
its name is PARTY 



When the user has specified all choice . alternatives , MAUD will ^^iv^ 
pfintout of all the; alternatives under consideiratidn and^ wxll ask if the 
want's to make any chart ges . - ^ ' 

MAUD allows the user to make several types of amendments: 



o 



a 

user 



o 
o 
o 

n 



(1) to eh^ge t^e naine of an item, 
{2)y\o delete ao^item, and 
(3) to add an item. 



You hav/e considered ^ - COLA ADS 

• COLA ADS under consideration : 

(1) PARTY 

• (S) -BERMUDA : 

(3) HAIR - 

(M): FISH- AND CHIP SHOP " 

Do you want to change anything ^ K0_ 



o 
O 
o 



IS 



YES 



2;3 MAUD will then help the 'user e3:icxt_attrai>utes _ relevant to^ge 
chSice alternatives under consideration by preseritin^ -° ^hH^S 

and askinq the user to specify differences 'ahd sijnilarities among the ^Iter- . 
nati'^ ThoL definitions will represe:.t the poles of the a^ril,ute._ dxmeh- 
s?on MAUD wi?i allow changes- if the user is not happy about the defxnxtxons 
given. 

u 
o 
o 

Q 

o 
o 
o 
o 

Q 

that 

o 
o 
p 
o 
o 



Can you specify a way in which one of these 

( 1 ) PARTY 
; E ) HAIR 
( 3 ) BERHUE^A 

"iT different from the other two f in aJway that matters^ 
to ybu now f Please Answer YES or NO 

jliJhat is the nurrfcep-next to the COLA AD~ 
that differs f 1. 



C> I You have said that I^ARTY 

\ is different from : r.r^r,M..Tv* 
^) HAIR '\ and BERnUDA 

\ In not more than .three words _each time-, please describe 

^ \ how the three differ from each other. 

0 ( First describe PARTY 

7 PARTY is : 

^ / PICKUP SITUATION , 

^ \ On the other hahdn -^y, 

1 HAIR and BERnUDA are 

^ ) ESTABLISHE!) COUPLES. _ ... • . 

U \ Are you reasonably happy with this description f YES - • 

2:4 The user.is then asked to rate ail the choice alternatives on 
dimtsnsion using a 7-pbint scale. 



o 



G 



- O 



O 



It should be possible to give each COLA AD 

a ratihg_frdm iVto =1 acfcording to its position 

on the scaie___ ' 



PICKUP SITUATION 



S to 



Your rating of PARTY _ 
Your rating of BERflUDA 

Your rating of HAIR - 

Your rating of FISH AND CHIP SHOP 
Are these ratings OK f YES 



15 

is 
is 
is 



1 

S 
5 



o 



B 



ESTABbiSHED COUPLES 



4 



2.5 Next, the user is asked to give an ideal 'point on the scale for 
that particular diinehsion. 

Thinking onl^y about the. scale below-, what position 

on the scale, would you like most of aii for Y 

an IDEAL COLA AD [q 

PICK LF SITbATION , " ( 

1 _ 

2 - _ : ^ \ O 

3 Your best possible value is ' §^ \ ^ 

H . I ' 

S to ^ __ _ ' JO 

£ Is this airightf YES ; ^ ^ 

7 ' ' 

s . . to 

3 : ; 

ESTABLISHED COUPLES 

2.6 After two triads of alternatives have been presented^ MKUD allows 
the user to specify poles of dimensions directlyuntii such time as. he or. 
she runs out of idea§ or has to restructure the problem (at which time MAUD 
returns to presenting triads in an effort to get things , going '^^gain) . , 

ei /O 

\ Can yoD think ' of any other, way that the COLA ADS I . 

) differ from each other f "^i^ ' ' V - 

g( " ^ • _ _ iO 

\ In not more than three words each timei please describe ^ y 

_ ( how some of them differ from the others: ( 

O I jO 

) Some are : DIFFERENT Sb06AN. / 

J Whereas others are : DIFFE[^ENT FORH OF JlfO OkE • " ( 

O ( ' . . , \ o 

I Are you reasonably happy with this description f 'i'ES V 



MAUD will then proceed to elicit ratings on a scale between these _po'les , 
as described in steps 4- and 5. • . 

2.7 MAUD allows the user to make several types of alterations: 

(.1) to change ratings of choice alternatives bn Vne scale, 

(2) to change ratings of ideal value, and ' ; 

(3) to "cancel the scale. 

In the exaiT?3le in step 6, the two p6les do not really lie on the same _ 
dimension. However, this is not realized until an atteinpt_is_ made to elicit 
an ideal point on the, scale between the "poles , at which time the scale is 
canceled and replaced' with a more appropriate scale. 



o 
o 



0 { Thinking only ^bbut the scale beiou-, what position 
oh the scale would, you like most of all- for 
an IWAt COtA AD 
O ) DIPPEREMT SLOGAN 
1 



y ■ 
S to 
b 

6 

■ ( DIFFERENT FO-RH OF dINGLE 



Your best possible value is : 5 
Is this alright? m 



o 
o 

Q 

c 

G 



o 
o 
d 



You can 

( 1 ) Cancel thi^scale (and ail ratings bh it) 

( E ) Change your ratings on this scale 

( 3 ) Change tKe position of tfie icteal value 

Which would ybu like to dof 
Please type in l-i E^ or 3 : i 



O 
O 

Q 



Q 
O 

e 
o 



€an you specify- a ijay in which one of these 



( 1 ) PARTY ' 

( E ) FISH. AN I) CHIP SHOP 
( 3 ) BERMUDA 



is different from the other two jin a way that- matters 

to you npw)f Please answer YES or NO 

yhat .is the number next to the COLA AD ^ 
that differs 1^ i . ' 



15 



o 
o 
o 

Q 



_You h5\/e 5aid_that PARTY 
" is di f f ereht from ^ • 

FISH AND CHIP SHOP 



and 



o 
o 
o 

... and so oh.- NOts that MAUD returns to u§ing triads here because the user 
restructured the problem by deleting a dimension:^ : 

2 8 If the pi;Jfeferences between choice " alternatives on any. two attribute 
dimensions are found by 'MAUD to be _ similar to each other, MSUD will ask the 
user if the two scales have a similar me.aning:. If that ;is the _ case , ^ MAUD 
will ask the u§er to. specify asnew attribute dimension^ that will replace 
those two* dimensions: If it is not the -case , MAUD will accept the user s 
verdict. ^ 



m not more than three words _e ach time n please cfescribe 
bow the three differ, from each other • 
•First describe PARTY : : 

PARTY - ~ is : ■ 

ONINTERRUPTED SLO&^ ^ . 

On_the other harid-i ; ^ - - „ 

FISH AMD CHIP SHOP ' and BERMUDA 

irJT€RRBPTED SLOGAN ' vr^ 

kre you reasonably happy . oith this description ,f ^ 



o 
o 

Q 

d 

Q 



Can you think of any other way that the COLA ADS 
differ from each other f YES y 

In not more than three oords each time-, please describe 
how some of them differ from the others: 

Some are' : nORE EXCI TING • -. 

Uhereas others are : LESS EXCITING 

Are you reasonably happy with; this description YES 

/■ ' . 



It should be possible to give each COLA AD 

1 to T according to its position 



o. 
o 
o 
o 



of 


a rating from 


on the scale 




1 nORE EXCITING 


G . 


1 1 








3 




1 q • 


' S to 




b 




7 




6 




1^^ 


0 


\ LESS EXCITING 



Your rating of PARTY 
Your rating of BERHUDA 

YdUr rating of HAIR _ ■ 

Your -rating, of FISH AND CHIP SHOP 
Are these ratings OK f .YES 



6 


< 


is 


: 1 


is 




15 


: -M 


is 





o 
.6 
o 
o 



*?our fjreferehces -fdr the/'' CGtA ADS- . 

ixider consi deration tgrms_pf their ^^^ings on the sc^^ 
ranging from mjINTERRUPTED SLOGAN to INTERRUPTED SLOGAN 

seem very much the same as. ,yotr preferences for the _ 
COL* ADS ♦^.--io terms of their ratings 

ori the scale ranging from MORE EXCITING 

"to LESS EXCITING , . ---i"- 

i>oes this meah that t.iese two scales mean simylar things 

to you f NO- 
OK . 



o 

0 

o 



Mere MAUD fc^^nd a sii^Uar pattern of preferences to those just elxcxted 
on a prevxousiy elicited dxrnenSion. However, the user deci^ded^ that the two 
dimensions were in fact value-wise independent, and MAUD accepted thxs In 
the next sequence. MAUDzagain' fincis- two similar patterns of preferences, and. 
tSs tSe'tS US.r decides that the relevant Scales are not value-w.se • 
independent. 



o 

O 



Can you think of any other^way that the^ COLA ADS- 

differ from each other f ' . j' 

j> • % 

in not more than three words each time,, please describe 
how some of them differ )fr>dm the others: ^ 
\ . ■ . ■ ■ ■ 

Some are : LACtCING ACtlON 

Whereas others are : LOTS OF ACT^W 

Are you reasonably happy with this description f ^ 



o 
o 

6 
o 



o 

Q 
Q 
'G 
G- 



It 'should" be possible to give each 'COLA AD 
a rating from 1 to according to" -tts position 
ohK-tSe*scale 
LACKING ACTION 

a 

3 

^ 

5 to 

k . • 

7 

a 

T ■ J 

LOTS OF ACTION 



your rating- of PARTY 
Your rating of|.BERrl)DA . ^ 

Your rating df: HAIg' 

Y.Jur rating of FKH_ AND CHIP SHOP 
Are these ratings OK f YES ' . 



5 



is 


: ^ 


is 


: 


is 


: 5 


is 


: 4 



G 
G 
G 
6 



8 



o 
o 
o 

0 



Thinking drily abbUt the scale beloa-i ohat position 
bh ythe scale would you like most of a?:l for 
an'^^JDEAL COLA AD 
tAfe'^^NS ACTION 
1 ' 



E 

.3 - 

y > 

^-5 to 
b 
7 
5 

LOTS OF ACTION 



Your best possible value is : 1_ 
is this airi^tf YES 



( 



o 

0 

© 
6 
0 



Your prefprences for the ^ COLA A^S _ 

under consideration in.terng'of thei,r ratings oh the scale 

ranging frdm MORE EXCITING tO LESS EXCJTiNiS 

seem very muth .the same as your preferences for the^ 
COLA^I?S ^ in_ternB_Qf their ratings 

on the 'scale ranging frotn LACKING ACTION 

to LOTS OF ACTION . ^ 

Does this mean that these fwo scales mean similar things, 
to you f YES i - ^ ' 



o 
o 
o 



MAUD then restructures the problem by deleting the . of fenaing dimensions 
ahd 'tnv^ttes the user to replace, them by hew dimension that expresses the 
meaning common ' to both the deleted ones; - 



o 
o 
o 
o 



> 

Please type one or rhdr^-Uidrds on the same line which could 

replace both ^ nORE -EXCiTitJ6 and 

LOTS 6F ACtiON ^ ' ' 

Your new,_word(s) f 

INVOLW-N^ 



Now please^type brie or riore jjords on the sam^ line whi 
.cbUld repljace both LESS EXCITING 

and tACkifslG IN ACTION - . . 



ch 



Ybur_new word (s) 
W t INWL mm 



o 

V 
6 

6 



ERIC 



i8 



Q 

Q 

P 
O 

d 



It sHdUld be possible to give" each COLA AD . 
aerating from 1 to T acccirding to its position 
on the scale 
Ij^INVOLVING 
1 ' 



E 

3 ■ 

^ 

s to 

7 - 
h 

NOT INVOLVING 



Your rating of PARTY 
Your rating -of BERHUDA 
Your rating of HAIR . - \ 
Your rating of FISH_ AND CHIP SHOP 
Are thGse ratings OK f YES 



'^2 9 When the u.^r has specified two or _mbr^_att:ri^nt^ dime;.sions, MAUD 
,will, if required, give ^ summary of progress to date-. 

; Here is > suimnary_ of _ France s ' progress at the ti;ne she had specified 
eight attribute atmensions -. 



d { Would yotj like to be reminded, of the information you 
have put in so farf ^ES 



o 



- % 



• u rr. >-oH;inPr^ " as it was printed but oh the StiO's printer, 

The summary is shown reduced, as xi:^wcii. px-Li 

"below and on the next two pages. ; 

\ 

SUnriARY FOR FRANCES >SEC5^P SESSfON ***** 
COhA ADS UNDER CONSIDERATION : - ^ 

(1) PARTY ■ - ' . . : 



•(2) BERHUDA 
(3) HAIR ■ . 
m) *F.iSH AND CHIP SHOP 



ATTRIBUTE DIHtNSIONS USED" 

(1) PICKUP SITUATION (1) 
IDEAL VALUE = E 



,T0 . . . . , ESTABLISHED COUPLES (1) ■ 



ID 



±9 



(5) • liiiTH BETTER dOKES (ij TO-.., UITH BORING JOKES (1) 

iDEftt VALUE. = 1 . 

(3) DIFFERENT SLOGAN (-I)-..... TO < DIFFERENT FORH OF JINfl.E n) 

(■RATINGS CANCEtLED ^N THIS SCALEi. 

(AFTER TRYING. TO ELICIT IDEAL POINT) . ■ ; - 

I \ . 

(M) UNINTERRUPTED SLOGAN ( 1) . . . . . .T6 . INTERRUPTED SLOGAN 

IDEAL V>LUE = E 

(S) nORE EXCITING (1) ..... -TO - LESS EXCITING 

IDEAL VALUE = 1 ' ' . 

(DirENSION CANCELLED BECAUSE OF SihlLARITY UITH DIHENSION b ) - 

(E) LACKING ACTION (L) ..... .TO ^. ....... • LOTS OF ACTION (^j ' 

IDEAL VALUE = 7 - . 

(DIHENSION CANCELLED BECAUSE OF Slf^ILARITY UITH DirENSION S ) 

(7) INVOLVING (l).-..-.TO \" NOT INVOLVING H) 

IDEAL VALUE =1 - \ \ 

(fi) .APPEALING TO BOYS ONLY (1) TO •••• APPEALING TO BOYS AND GIRLS 

IDEAL VALUE =7 



RATINGS OF COLA ADS ON/ATTRIBUTE DlflENSIONS 

COLA_AD__ 1 E 3 M 

ATTRIBUTE ^ 

DiriENSION — 

(l) l.QD \n'UU 5-DD E-DD ' 

VAfeUE .75' -□□ -SS 1-DQ 

(B) ^ 3. BO 7.DD S-DP: E. 00 

VALUE -BD .□□ -40 l-OO 

(3) S.QD S-QQ S.QD 3.DD 

(RATiNGS CANCELLED) 

(q) I'-DD T-DD T-QO ^-SO 

VALUE 1-BQ .□□ -OD .□□ . 

iS)"' b-DD 4-OQ 4.DD 

VALUE 1-QQ -30 --HD- -AU 

(RATINGS CANCELL£D BECAUSE OF SiniLARITY TO b 

(E)' 7.DD E.QO S-na 4.03 

' VALUE 1. BO _-EP -40 

(RATINGS CANCELLED BECAUSE OF SiniLARITY TO 5 

V : ' 

) ■ ' 




) 



j 



(7) i-OQ L.oo 3;oo ^.oo ^ 

value: 1-OD -00 -bO -MB 

(S) b-SS 5.DQ S-DO 3.DD 

VALUE 1.00 -75 -00 -25 



«## ENl) OF sunriARY 



2.10 Investigation of-^g&^ence S truct xjre 
■ When ^e user thinks that he or she has specif ied; the' requisite attri= 

gainbtes, o? _ trades off values on attribute dajnensxpns. ^ 

«^?LaeLTB^ .. t.M, « Its s„ 

: of cola advert Iseinents . •, ' . ^ 

Do you think you ha\« now worked through ehdUgh^o \q 

\ main ways of descritsing similarities and differences i 

\ between the COLA ADS ^ "hich you ^ [ 

Q I think are '.impbrtaht f \ YES > J 

/ Do you want to investigate your preferences among the • ( ^ 

0( COLA M on the basis of the similarities iQ 

I and differences you have ' described so far ? ^ / \ - 



Q / Uduld you liki td assuna that the various ways you have used I Q 

to describe the COLA ADS ' . 

are equally important in determining your preferences NO ■ 



KAUD now construct^ and displays the BRLTs. 



■ 12 

I 



21 
f 



u 
o 

o, 
o 
o 
o 



Imagine you had to choose 
and 

; OPtiON A 

A IpDoVb chance, to ,get a 

COLA AD that is 

as UiTH BETTER JOKES 

"as FISH AND CHIP SHOP 

but that is also 

as ESTABLISHED COUPLES 

as BERMUDA 

* - . . for sure 
liJHICH WOULD YOU PREFER: A 



that is 



between _ _ _^ OPTION B 

A ^do/o chance to get c 

fOLA.AD ' 

as liIITH BETTER JOKES 
'as FISH AND "CHIP SHOP 

and as PICKUP SlTUATiON 
. as -FISH AND CHIP SHOP 
AND a lOd/d chance ^to get instead 

a COLA AD that is ' 

as tdiTH BORING JOKES. 

as BERMUDA : 

and as ESTABLISHED COLPLES 

as BERriUDA 

OR BfB 



P 

o 
o 
o 

Q 



Option A lis a compromise "^ola^ad (best on one diinension, worst pn the 
other). Option B represents a gaiSle with ; a 90%. chance to get an .advertise- 
ment that is best in both dimensions ind a 10% chanceto get ah advertisement 
that is worst on both da:iTiehsiohs . So long as option B is preferred, the 
chance of best advertisement by choosing option B is adjusted progressively 
downward by MAUD \intil it becomes so unattractive tha;troption A is preferred. 
For Frances, this happened at the following p>oirit : 



Q 
O 
O 
O 
O 



Imagine you had to choose 
and 

OPTION A 

A IDDo/b chancf to get a 

COLA AD that is 

as WITH BETTER dOKES 

as FiSH AND CRIP SHOP 

but that is also 

•as ESTABLISHED COUPLES ' 

as BERMUDA / • 

. • . • for sure 

WHICH UbUtD YOU PREFER: A 



between' _ _ OPTION B flt ^ 

A 706/6 chance to gat a 
COLA AD that is 

as UITH BETTER_JOKES_ ' ) Q 

as FISH AND CHiP SHOP 
and as PICKUP SITUATION ^ 
as FISH AND CHIP SH^P \ O 

AND_a 30o/o. chance to get instead 
a COLA AD that is . 
as lillTH B0RIN6 JOKES f O 

as' BERMUDA . _ _ _ 

and as_ESTABLISHBD COUPLES' 
as BERMUDA ( O' 

OR BfA ARE YOU SUREf YES. 



. Frances had "fiv.fe (riorideleted) dimensions in her preference stra^ure , 
and MSUD had to construpt four (=5-1) BRLTs in order to full^ir investigate 
her pref err "ices . The other three BRLTs ar^ shown next. In each case the 
percentages shown in option B are those at Which- Frances started 'to prefer 
option fi. ' . * • ' • ~ 



13. 



S2- 



Imagine you had to choose 

and 

-OPTION A 

A IODd/d chance to get a 
COLA AD that is 
as INVOLVING 
as PARTY . - 

bat that is_ also 

as INTERRUPTED SLOGAN 
as' BERMUDA 

.... for sure 



IJHICH UOULD YOU PREFER: A OR 



en __ . OPTION B 

A BDb/o chance to get a 

COLA AD that is 

as INVOLVING 

as PARTY 

and as UNINTERRUPTED SLOGAN 
as PARTY 

AND _a 5Do/o chance to get instead 

a COLA AD that is 

as NOT INVOLVING 

■as BERMUDA 

and_as INTERRUPTED SLOGAN 

as BERnUDA 
A ' ARE YOU SUREf -YES 



Imagine you had to choose between OPTION B 

• A_MDb/D chance to get a „ _ 

OPTIOr: A ' COLA AD that is 

as APPEALING TO BOYS AND GIRLS 
A lODo/o^chance to get a as PARTY 

COLA ^AD that is and_as_iNVpLVING 

as APPEALING TO BOYS AND GIRLS ._aS PARTY / : 

as PARTY - ^^^^^ 3. bDo/o chance to get instead 

but that-ds also a COLA AD that is 

as NOT INVOLVING as APPEALING TO BOYS ONLY 

as BERMUDA _ • as UAIR 

for sure and as NOT INVOLVING 

as BERriUDA 
UHICH UOULD YOtJ PREFER: A OR BfA_ 



Imagine you had to choose 

and \ 

OPTION A 

A iQQo/o chance co -get a 
COLA AD that is • . 
'as INVOLVING 
as PARTY 

but that_is_alsq 

as UITH BORING JOKES • 
as BERMUDA 

for- sure 



between . OPTION ^B 

A SDo/c chance to get a . 

COLA AD that is 

as INVOLVING 
as PARTY 

^nd as bJITH BETTER "JOKES 

as FiSB AND CHIP SHOP ^ 

AND a SDo/o^ chance to get instead 
^k^COLA AD that is 
as NOT INVOLVING 
as BERMUDA " 

and as UITH 'BORirJG JOKES 
, V as BERMUDA 



/UHICH UOULD YOU^ PREFER: A OR B'^M 



ARE YOU SURE^ YES 



G)( That is the end of the gues VO 

- \ investigate your pnafef*ences among the 

A \ €OLA ACS under cons icterat ion. ^ \ 

\ ■ : * ' - •> 

MAUD then gives the us^' a summary , ' similar to . that de.^ribed in sec- 
tion 2.9 , except that value-Cise importances (relative 'weights of attribute^ 
dimensions, calculated from the" BRLTs) 4re included, as are the preference*^ 
values for the- choice alternatives. A preference value of 1.0 indica's^es that, 
ah alternative is at least as good as all' other*alte_inatives_ on all dinen- x 
sions, whereas a preference _ value of 0 .0 -indicates that ^.alternative is at 
least as' bad as all. oth^r alternatives on all attribute c^imensions. Inter- 
mediate values ma^v biB interpreted pro ^ata;^ 

The jsumxnary MAUD pi^ovided {or I'rahces at the end of the, session from 
which the above examples Wore taken is reproduced b'-=iow: 



***** SUnriARY FOR TRANCES SFCON^ SESSION ***** 



COLA AI>S_.UNI)ER CONSIIERATION 
(i) PARTY 

PREFERENCE VALIF, = -^75 ^ 



(2) BERMUDA : 
PREFERENCE VAttE = .275 

. / 

(3) HAIR 

PI^PERENCE VALUE = .307 



CURREr>IT PREFERENCE ORDERING (FROM BEST TO 
liIORST=iPREFERENCE VALUES ARE GIVEN IN BRACKETS) 



BEST . 

PARTY ( .^a ) 
FISH AND CHIP SHOP ( 
HAlPa_ . -31 ) .. 
BERMUDA ( -EB ) 
lilORST 



.3a ) 



{M3 FISH AND CHIP SHOP_ 
PREFERENCE VALUE = -377 



W END OF SUMMARY 



ATTRIBUTE DIMENSIONS USED- 

• / 

(1) PICKUP SITUATION (D TO^^^- ESTABLISHED COUPLES (^) 

IDEAL_V^ALUE = 2 

RELATIVE irPORTANCE = -05^ 

(2) ' UIITH BETTER JOKES (1) . . . . . -TO. . . . I . . - . . UITH^ BORING JOKES (^) 
• . IDEAL VALUE = 1 ' . 

RELATi^.'E inPORTAN€E = •Q7'1 

(3) LIFFERENT SLOGAN (i) Te DIFFERENT FOrH OF JINGLE (T) 

tRATiriGS eANCELLEfi eN_lRlS_SCALE) . - 

(AFTER TRYING TO uLICIT IDEAL POINT) 

■ 15 . • . 



m UNINTERRUPTED SLOGAN (i) TO • ......... INTERRtFTED SLOGAN (^) 

s IDEAL VALUE = S .. . - 

. ILLATIVE inPORTANCE = .07^ : • ' , 

i . ■ , ■ ' 

(5) nORE EX<:iTiNl (lK.....TO...... ^ / ■' 

(DiriEmmj" CAN^LLED BECAUSE OF SIMILARITY UITH DIMENSION hi' 
(b) 'LACKING ACTION .'(1) . . . . .-.TO. ......... LOTS OF ACTION (^) 

(dimeSion"«nSlled because of similarity uith dimension 5 5 

(7) INVOLVING. (1)...... TO... NOT INVOLVING H) 

IDEAL_VALUE = 1 - ~: 

" RELATIVE IMPORTANGE = .M4a 

■ . -u T/s APPEALING TO BOYS AND GIRLS (^) 

(S) APPEALiNG_TO BOYS ONLY (1) TO APHtALiNb 

■iDEAL^WLUE = ?_ _ ' . z, - 
RELS-tlVE IMPORTANCE = .357 . 



ratings' OF COLA ADS ON ATTRIBUTE DirtNSION^ 

COLA AI>_ 1 2- a ^ 
ATTRIBUTE v 
DinENSION ^ 

fi) b.OO S.QQ S.OD 

VALUE .75 .QQ .25 l-UO 

(E) ■ _ 3.DD T^OD S.OD S.QD 
VALUE .SD -QQ .flQ 

(3) - :?5.QD 5.DD S-DD 3.QQ 

(Ratings'- CANCELLED) 

(q)'' i.QD T.DD T-DD T-DD 

VAttJE l.DD ■ -DD '.DD .QD 

- ' ■ • 

(S) l.OQ fe.QD M.DP q.DD 

VALtE i.QD .DD .MD .ME3 

(RAT JSCANCELLE^D BECAUSE OF SIMILARITY- TO b 

(5) 7.(30 S.QD 5.DD M.DD 

VALUE l.DD :.Qa -bO -^S^^^-, s 
(RATINGS CANCELLED BECAUSE OF SIMILARITY TO S 
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ERIC 



(7) l-DQ b.QQ B.QQ 4.03 

VALUE i.QB .□□ -bO -40 



(S) t'iOO S.DD P-QO 3.QQ 

VALUE i.QQ -Ti. .QQ .2S 



2,11 When the user think? that he or she has done enough at the ses- 
sion, MAUD will allow him or her to save the data. 



Do you want to save all this information f YES 



Oj FILE NUriBER FOR PATAf 



Eight MAUD sessions can be saved on a MAUD tape.__Data from each session aW. 
stored in- four filis. The file hl^Jriber for storing .a session -^s. results must 
be 4, 8, 12 r 16, 20, 24^ 28, or 32. Files may be reused at will, but each 
■time a file is reused, the data from the. session previously stored in that 
file are overwritten with the data froirt the new session. 

2.12, MAUD ends. ^ . ' 

Notes on MAUD Opera t ion 

1 Press the EXECUTE key after every entry. MAUD will begln__tp process 
information dnlyafter the key is pressed. Pressing E)4:CUTE indi- 
cates termination of entry. 

2 When a typing error occurs before the EXECUTEkey is u§ed, the user 
can make corrections by using the backspace key ) ; pressonce for 
every character to be deleted. The user can then proceedto over- 
write the error. However, if the EJ^CUTE key has been used,. leave 
the error for n_ow_ana carry on; MAUD will. also allow cbrrectibhs at 
the end of every procedure. 

3. MULTIATTRIBDTE UTILITY THEORY RELATING TO MAUD 



3 . 1 Overvx ew 

This part of the report describes the. rationale and operation of Muiti-: 
attribute Utility Decomposition (r-lAUD). within the context 'of Multiattribute , 
Utility Theory (MAUT) . In sectibri_3^2 we introduce MAUT as part of . the __ 
multilevel decomposition-recomposition scheme used within decisiori-theoretxc 
models.^ 



^Much of the material in this section .is abridged and developed from that 
presented in Humphreys (1977), to^v/hich the reader is referred for further 
discussion of the general issues fai'sed here. , 
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Secidh. 3:3 snd 3.4 review the MAOT .xtomat±za|ions jj/^jgHf 
of outconss (terminal events) 

"tskv choice, respectively. MSUD adopts various solutions npon detection 
of viofatiots of Se .ssu^ptions involved ^^^^^''^^^l^X^,^. 
each solution is discussed in the :sectidn reviewing the relevant assun^t 

section 3.5 discuss.^ the Sapping rulei transforming g^J^^ J^f 
l^m by the user (Stings on attribute dimensions) into a form suitable 
use in the composition rules used within MADD. 

Finally s-ectibav3-6 provides an evaluation of the algorithms imple- 
n^ntin ^he'^oSosftion'ru^es used within -UO -^^^^^^ ^ "^"^ ' 

some algorithms not currently implemented within MAUD. 

'( 3^2 MUl tiattribute Utility^h ^o^ _ as Part of a Multilev^ 

X Decompos4t4ott^eom.p osition Scheme 

what basis "---^ ""%"SfSed axiomatic system. MSUT axiomatizes 

terms, a decomposition under a =P^-=^™^^':°"^f possible outcomes 

a farther decomposition of_the decomposition of ^ ^^^^^^^^^^^^^ - 
D-Ovided by the joint axiomatization of_utility and subjective ,^57, 

&own as E'p.c:tea Utility (EU) ^ ^ ' .'"^ [^"^ lrS.£ni ^ ks^ 

MAUD is a system providing the_technology required to (a) i^lement_^ 



de compos 
fol lows : 



D^con^po^i^n to Level 1: Choice Alternatives 

(Klfta, 1968; 6row. K^r 5 P.tar.on 1974) Thjr. ^ ^^^^^ ^ 

^Sher through extension of the event-act; decision tree . Utilities must 
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1. Thrpugh holistic utility assessments at level 1 ; that is , ..the. 
utilities of the outcomes are assessed directly , without further 
dec^position . 

_ , _ _ _ 

2. Thrbugh the assessment of vctlue*^ terms of some variable believed 
to have a concrete, measurable existence' in the real world and to 
be coextensive with, utility; for "example^ money. Value is mapped 
into utility, through the use of a mapping rule assessed prevxously 

: for that decision maJcer: his or her utilij;y functioK. 

3. Through the use. of a.MAUT deqomposition -Of^he utilities of the 
choice alternatives into multiattribute f orm. 

MAUD Will be of interest only to_those who-have adopted strategy 3 in 
assigning utilities to consequences .of teminal acts. 

Decomposition to Level 2t Multiattr ibut ed Outcome s- ^ : 

The choice alternativeto be decomposed to level 2 may be specifiedin 
either of two ways: under the assumption of riskless decision makxng, or 
under the assumption of risky decision making.;. The technology employed xn 
MAUD is. appropriate for use in either case, but the theory is presented 
separately forjth^ two cases. 

Under riskless decision making, the decision maker is assumed to be 
able to specify with certainty the outcomes ^consequences) associated wxth 
each course of action. Hence, identity rules are suitable formappxng be- 
tween outcones ^d choice alternatives. An example of such mappxfig follows; 

- v_- . 

cho ice altern ative T Hire an unspecified car from Rolls Royce Car 

Hire,_Ltd. , rather than from some other car 
hire firm. • • 

Drive a Rolls Royce (P = 1-0) 



Under -risky decision making, the decision maker is assumed to be able 

to specify^ probability distribution over the outcomes associated with 

each choice alternative. !4apping between outcomes and choice alternatives 
requires the use of a composition rule, usually based on the expecte_d _ 
utility principle (Fischer, 1972b, p. iO^ - Under this principle , if the 
set of choice alternatives is denoted by (Ai^.^s, A^, A^) / and theset of 
divtcomes under consideration by (Xi , X2 , X j , X^) , then the EU of the k^n 
alternative is given by the composition rale; 



j=l 

where Pj^ is the prob^ility of the .choice of alternative resulting in 
oat come X j . ' , 
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An example, of a sitaation requiring such a mapping i= = ^ 

"■Quiice alternative k: Hire an onspeafied car from Gerielral Car Hi^e , 
Choice alternative . ^^^^ ^ ^^^^ ^^^^ ^^^^^ ^^^^ 



firm.' 



Outcome : (D Drive a mini - = O'^O) 

of (2) Drive a VW, (P2k r 

or (3) Drive a Jaguar- (^sk - ^ '^^l 

(A\ nrive a Rolls Rovce {^aC = 0.01) 



or 



(4) Drive a Rolls Royce (P^^ 



It is important to remejr^er . that , . given . th^ existence o^ a decomposition 

■a.coio:itJ°n of » identical to dSoo«p.=ltic„ of ohoiee..lt,™- 

tives, but in risky situations, it is not. . - *. 

r.=.h.r n972a) von Wihterfeidt and Fisdier (1975) have described in 

detail^thr de^oS^itS to level ^_ P-vided^.^^ from 

ment point of^vieW '''^^^^ M^^^^^ons^^^^^^^ 

lined in ^^'=^^°"|^J.3 and 3 9 together ,saU«ptions nec.s^ry under 

that can be adopted in applications or n/i^ _ descriptions of the way in 
MAUT axiomatizations are found not to be met, and description 
which MAUD implements particular solutions.. 

nf nr comp os it i on of Ou tcomes to Level^ 

3 3 MA TfT & V1 nm atiaatiaa o t uecompotoxu-L^^j. 

Adeguafee- for Riskless Choice 

■sr.rir/ifJifnroKoiS""«s*5^^^^^^ , 

ana independence asiumptions discussed next. j . 

3.3.1 Monotonicity Assumption ' ^ 

~ Given the adoption of an^ ordered scaling metric describing positions of 
attributes S dimensions, the Wotonxcxty assumption requires that the 
SlJvant attribute dimensions be.kcaled in such a way that - 

-ij ^ ^ik' ^'"ij^ ' '^"ik' ' . V- X 



V, rh. attribute of outcome X, and fCxij) is a numerical scale 

where x-^ is the i ^^^triiute ot ^ attribute' dimension i. The > denotes 

value_ representing the utility or ^13 o^H>,t-ps "is numerically greater 

s,for?f a.r"S'ro%sr.r.«"r.ro;.S"oj ^.,o,..i , 
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. - 

cbmpositidn rules in appl±cat±5ni of MAUT. The _MAOT a:<ldmat±zatibn is con- 
cerlied fundamentally with relations t-^tween pref^ence order.ngs> no^ 
tiOhB between scale values . Such scale values re^present an, interpretation 
of ordered relations, 

When scaled values as obtained' do hpt represent. this interpretation, 
mapping techniques such as those described in section 3.5 may be^employed ^ 
to reslale the values in such a way that the monotonicity assumption is jnet. 

' « - • 

3.3.2 Value-Wise I nd e penden ce tesmnption, - _^ ' , . 

- Raiffa (1969) describes how to specify this assumption in_te^s pf_^Weak 
conditional Utility , independence -(WCUI) , which states that preferences for 
values on any attribute dimension- should be indepen-^ent Of constant values^ 
on all other attribute dimensions. Such preferences are called conditional 
preferences. This assumption is equivalent to M^e^ single cancellation as- 
smnption in conjoint measurement theory (Krantz , Luce , Suppes , S Tversky, 
1971) ^'d, taken together with joint independence^ ( section^3 . 3 . 3) , is some- 
times called preference independence^ XFishburh _ S .Kegiey , 1975 ; ^K^ 197^;; 
Keeney S Raiffa.^ 1976). It is usually tested by checking n-WCUI , that is, 
performing 1-WCUI checks, Over all n attribute dimens^aons, where rVWCUI 
SpresentI a che.ck to determine if (any) one attrib^ute is WCOI ofJall others 
(Siffa,-1969; von Winterfeldt S Fischer , _1975): /%he notion ^of independence 
contained -in WCUI is weaker than_that contained in notions of statistical 
independence- Hence tests of s,tatistical independence How 
ever, tMy may be used to indicate the ^possibility of a violation , of WCUI . 
Hence sach a check is used by MAUD as a guide for further actions , as- de- 
scrUbed next. ^ 

i^llure of ^h-WCUl' Checks in fippl4pat4ms-of 1 ^. ' Give^. ^ 
n-WCUl checks, one has two (legitimate) options open.: (a) recognize that 
no toLl-decor^pdsitiion model is adequate within the existing structure and 
opt for a partial decomposition model, or (b) keep the total decomposition 
model and reorder the attribute dimension structure in such a way as to 
eliminSe (or at least, minimize) violation of n^WCUI between the reordered 
attribute dimensions : ^ I 

' ThS consequence of opting for a partial decomposition model is that one 
has to re'f^atedly search for dinensions exhiJ^iting X-^,^^ ^^to" 
stituting values of the 1-WCUI dimensions |dr values on ail the non WCUI _ 
dimensions (Raif f a , 196?) . This procedure may require the construction^of 
a iarie number of indifference curves to be able to perform_th|..:necessary 
lubKitutions.S The result is an e^^onential^ncreass in t^e'nurrtoer of as- 
SlmeS required Before one can bootstrap the decision maker by c>E^tatin(g\ 
SrSmpositi^n rule, and, as von Winterfeldt (1975, p. 65) s^id, -Th.s may 
be too much effort." ' \ 

The alternative of keeping the total decomposition model me'ans.that an 
additive composition rule is .till appropriate , and therefore feWer assessment 



^See Macerimmon and Siu (197^, p. 694.) and Humphreys (1977, section 2 . 3; 1) 
for details of the procedures involved. ' 
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neeato be ^de befbre operating the rule; -However> decision a^ds, such as 
-IS, ?hat opt for this approach must contain f acilities_f or axdxng the 
structural reordertog £hat may consequently become necessary durxng an 
analysis: 

"consider the exafflple of a decision m^er who "^^^"^.^^.^.^^^ ' 
whose multiattritoute representation of the cars under consideration (Rover 
too! cftroen CX, Skoda Estelle, ^.n-lt 14) is based engrely on n^^^^^^^ 
of speed, comfort, and financial disincentive. _ Suppose the eticxtatxon pro 
cedure resulted in attribute values (data) on the four dimensxons shown xn 
tile extract MAUD log reproduced below, , v , 

.. 1.' slow' (1) ...... to ........ (9) fast _ 

2. .uncomfortable (1) to ......... (9) comfortable ^ 

3. costs a little (1) ...."to ........ (9) costs a lot 

. u i- /^^ tn (9) xnaJces a little hole 

4 makes a big hole (1) ^° ^ _^ ^ 

^ '^ , ^ in my bank account 

in my bank account • ^ 

and that the representation of his or her preference; structure was as follows, 



(U 



score on 

attribute aintension 
1 
2 
3 
4 



o 
o 



s 



eg 



:3 

fJ3 / 



.-_o 
or 


4J 


-O 




9 


8 


1 


5 /■ 


9 


9 


1 


6 










. 7 


8 


1 


5 


3 


1 


8 . 


5 











ideal point on 



attribute diinension; 
; 

9 
9 



^ Checks for- statistical independence would ^ reveal that ratings . on dimen- 

- 4 ^-re hiQhlv correlated but would also reveal that rating^ on 

diS JoS^'a^r? aS'Lghly correlated (the .aster 

were also more comfortable). The source of the latter correlation lxes_xn 
the. external wdrld-the structure of the automobile, industry .an^ x|s market 
SjpSiSes-not the intePnal'Worth structure of the individual , for whom 
speed and comfort are almost certainly value-wise independent. 

MAUD disambiguate, this situation ^V-^-^^ f ^--^^^J^f ^g^ggf 
procedure to monitor potential ^--^^^^^ ^l ^-'^^^i ^'^^^^^^^ 
ditnen-^ion and evfery other dinenBion already in the structure as they are 
luSitla fSm the decision maker. Should the_statisticat check fail, the 
off^ffig pair of attribute dimensions "i^ presented to the decision maker,_ 



arid k thought experiment is then cbhauc'tea between^MSUD and th%, decistLOn . 
niaker to see if 1=WCUI has actually been violated. « If it has, the decision 
niiJcer is prompted to supply a new attribute dimertsion to replace the offend- 
ing pair, and the structure is then reordered by accepting the new dimension 
and deleting the of f ending_ pair , providing that assessments, on the new di- • 
mension subsequently pass 1-WCUl checdts. : - ; . 

.. / _ _\ _ 

In the example, mvu would check the correlation 'betwfeen ratings on di- 
mensions 1 and 2 as soon as ratings had been elicited on dimension '2. Find- 
ing a high correlation between the two sets of _ ratings^ MAUD would proceed ^ 
with the thought experiment as shown in the fbllbwing printout: . ■ 

y : - - ~^ \ 

O ( Your preferences for the CARS _ ' ^ 

under consideration in terms of their ratings on the scale 

^ . ranging from SLOli) - to FAST 

O [ seem very much the same 'as your preferences for the 

^ (-^RS , ■ in_ terms of their ratings 

^ f on the scale ranging from UNCOHFORTABLE ' *\ O 

O \ to eonFORTABLE _ : , . 

Does this_ pari that the^e too scales mean similar things 

to you ? NO • , I Q 



o 



OK . ■ -i 



Because in each case WCUI survived (although _ statistically independence 
did not) , MAUD proceeds with the elicitation of dimension 3. Ratings on 
dimension 3 correlate riegatively with ratings on dimensions 1 and 2 , so nq 
thought e:.<periment is performed, ^d MSDD procee'ds with the elicitation of 
ratings on dimension 4. Finding a high positive correlation between ratxngs 
on- dimghsions 3 and 4, MAUD proceeds as follows: 



r 



O 
O 

0 

o 



: ' ■ ^ [ O 

Your preferences for the CARS " _ Y 

LTider consideration iri terns of their ratings ori^fche scale ^ ^ 
ranging from COSTS A tJTTLE tg_COSTS A LOT 

seem very much the same as your preferences for the f 

g^R^ . _ in terms of their _ratin§s ) ^ 

on the scale ranging from . BIG HOLE IN BANK ACCOUNT <^ 

, tb LITTLE HOLE ^IN BANf^ ACCOUNT _ \ 

y Does this mean that these two scales mean similar things - ( ^ 

' to you f YES ■ / 



"^MAUD'S procedure has the advantage that fewer questions need.be asked than 
in conventional 1-WCUI checJcing and that it leads .decision makers to b^lieve 
that the "system is .intelligent because it asks questions. onli^ in suspicious 



circumstances . 
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-On 



r 



O.K. Please typi in. a ,word (orphraie 5f Hot nore than ; 
gsfs: f [mtf '^"'In^LJlTfe^HOLf IN BANK ACCOUNT 



YbUr new word(s) 
CHEMP 



- y 




Ndu) pleasp type in • a ward_ (or phrase ,of not^more than 
?0?TS A#T^ -'^In^BIGloLE In'baNK ACCOUNT 

i'bUr hew WDrd(s) - • : 

EXPENSIVE 

(MAUD_then proceeds to elicit ratings of cars dh the dimension CHEAP to . 

EXPENSIVE.) - \ " • 

/• 

Hence ■din.ensions 3 ana..4 «re deleted from_the structure and replaced by 
din^nsion 3', eX^.nsive . . . to . . . cheap. WCUI is restored,! and MAUD may 
now bontinoe 'With the eltcitation of the rest of the structure. 5 



3.3.3 Joint.- liidepenaence Assumption 



men n-^WCUI is satisfied, a final general -'^-^"'^^"^^.^^^^^^"^^"T 
be m^t. This assumption is called joint independence. -In formal _terms . 
-sit. of attributes is said to .jointly inaependent _ of the rest xfj| 
Preference ordering of outcomes , Nwhich varies onlyin these attributes, re 
SlSSvIriS for a«y fixed le4ls of_the. remaining attri±.utes .Von. Kxnter- 
^lat Sd lircher \l9J5) state that violations (gf^joi^t , independence xn con- 
ditionrin wSh n-WCUI is .atis,fied^are^ typically^ subtl. j^^^^g^-*,^, 
to find- Thev give the example* of someone. who works m a large city and wants 
S rS?'a hdSeOr apartment! Consider this__persori:s preferences "hen con- 
froSSd With the two situations shown in^Figure 1, jiiffering only in whether 
there is a h.ighrspeed transpQf tation system situated nearby. 

^-T" 1 i„ r-e>l.lc ffsfiresent the values of the 

In each situation , the values m the cells represeni. i-ne 

dutcornes on the three attribute djjriensions. . ' , 

Von V^interfeiat and Fischer explain, the switch in preference orde^ing^ 
of ouSme B a^d C between the two situation, (violating ooxnt independence) 
as f oa:low5 : ^ ' 

Living on- a farm in the country, seemed to us- very attrao^ve, and 
the long car ride to work c^d: ndt::mattar with the convenience of 
• Se- fS speed tiansportatln sys^m. With no high speed transportation 



^Mor*. also that the as^ssment procednre used to establish the decision 
maker's valS'wiS importance weights for attribute dimensions (described 
■f section ite) i. ordered ^ r^UD into ^ .hierarchy, in' . way that minimizes, 
Se distortion introduced in__any residual vaiue-wise nonindependence ttiat 
was not detected by the l-yVJCUI checks. 
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s^^stem, the shorter riSe from the apartment outweighed the beriefits 
of living On the farm. 



Situat ibh 1 
butcbines (dwellings) 



Fm 


Fm 


AP 


Ap 


20 
min 


Ihr 


20 
min 


Ihr 


YES 


YES 


YES 


YES 



attribute 
type 

time' to drive- 
car to work 

high-speed_ 
transportation 
system nearby 

ORDER OF . 
PREFEPENCE 



Situatio n 2 
dutcomss (dwellings) 



B 



-D- 



Fm 


Fm 


Ap 


Ap 


20 
ndn 


Ihr 


20 
min 


Ihr 


NO 


NO 


NO 


NO 



Figure 1. Two situations involving preferences for outcomes where 
the preference orderings violate joint independence 
(after von Winterfsldt 5 Fischer, 1975. Fm =. Farfn; 
Ap s" ApartirEnt) ; ' " ' ■ 



' Failure of Joint Inaependeftce Checks in Applications of MAO^ . ,_Gxven 
failure of joint independence checks, one has the s^e ftwd^optiojis openjas 
in the case of faiture of n -WCU I checks : (a)^ recognize that no total de- 
composition model rs adequate within the^existing structure, or ,(bKke^^ 
the totil decompogltion model .and 'reordeX the attribute dimension strudtare 
in a way that eliminates the violation of joint independence. 

r _ : ' , / • : 

If one tetainarthe original . structure ,. a total decompositior is 
theory still possible .- This total decomposition is described by von Winter- 
feldt and Fischer's (1975) .model 1.3. Howeve^ , .such a total- decomposition 
is ittadequate because no composition' rule is iSrescribed axiomatiqally^for 
this decomposition, and an optimal, solution requires _a mixture of admtssi- 
SitJ Sd sensitivity analyses on the applipation of a well-,chosen: selection 
of cbnfJbsition rules 1 ' . . , . • . ' • 

The inforhiation required to'cascertain that _any solution on these lines 
is usually hbt available so MAUD opts fof a different solution, that pre- ^_ 
vidusly described by Humphreys (1977, section 2.5.2) as the r'conatructivist 
solution . ^ ' 

This solution gives primacy to the MAUT axibmatization bverthe data 
and seeks to modify the output of the attribute elicitai;ibn procedure so 
that the modified attributes esdilbit joi^t independence. -^In the e«ample 
-luifused, the absence of a high-speed trSnsportatibn system (situation^ 2) 
resulted in dimension 2, "time to drive car to work," increasing- its value- 
vise importa.nt weight over diu^nsion t, "type of dwelling (farm.or /apartmerrt) 
Why? " ' ; • J - 
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Diirierisibh 2 may be assumed to extend between these two poles: 



Pole P 




Dimension 2 



to 



Pole Q / 



khort time to drive 
car to .work 



For attributes to be scaled in any metric on a dimension, the pole names 
of that diinension mast be superordinate -category names , that is . refer to 

■poles superordinate to their predictive attributes^ or lexical entrxe^^ jBruner 
Goodnow, £?> Austin, 1956, Katz S Fodor^ 1963; Humphreys S Humphreys, l^^S^ . 
For each pole, the -set of lexical entries defines- its ti^anxng (Katz S Fodor , 
1963, Anderson S Bower, 1974). In situation 1 in the dwellings example, 
Pdle-P contadns the lexical entpy "but not for me," because, in this sitna- 
tion, the decision maker would take -the high-speed_ transportation system. 

-^n situation 2, gdle P contains instead the" lexical entry "for me, because 
there is nO option but to take the car. Hence, what is happening in this • 
violation of joint independence is that pole P changes ia meaning. 

• ) 

The constructivist appiroach would assum^ that in the situations described 
in the exaitpte, the decision m^er was really construing the decis_ion situ^^ 
tion through the^uie of an attribute dimension defined in terms of these two 
poles:' 



Pole P' 



long tiire fbr me to. 
t ravel to work 



Dimension 2 ' 



to 



Pole Q' 



short time for me 
to travel 'to work 



The reader is invited to verify that attrii)utes scaled, on dinehsions 1 
and 2' do not violate joint independence for .^y fixed level on dxmensxon 3. 

MSDD -can pick up violation of joint ihdependence^through . deteCting^in- 
^coherence in the resulting assessments r^uired^n the lotteries required 
to est^lish. value-wise importance weights (descrii)ed in sectioq 3.6^- ■ 

However, the user will bften spot a dimension changing its meaning a§ ; 
ratings are elicfted and take, appropriate Action in interaction Witt MAtJD 
before proceeding in the development' of His or her preference • structure ^ ^ 
3e following is a simulated example of this action happening during a MAUD 
run, based on the von Winterfeldt and Fischer exanple: 



^Hote that thesi attributes define poles, not outcomes. 
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3S 



Yuu have considenecT M DlilELLINiSS 

rWELLIMGS' urideh consibenation : 

1 FARhi 

B FARDB 

3 APARfriENTl 

M APARTrENTg 



it should'.be possible tb_give each DLIELLING^ 
a rating from 1 to T according to its position 
bri the scale 

HST SYSTEM NEARBY. 

1 Your rating of FARMl 

2 Your rating of FARMS 

3 Your rating of APARTnENTl 
M Your rating of APARTflENTg 
5 to Are these ratings OK f YES 

I 

NO HST SYSTEM NEARBY 



Thinking only about the scale below-, ohat position 
on the scale would you like most of ail for 
^II£AL DWELLING 
HST SYSTEM NEARBY 
i , 

3 ^ ' Yotr best possible value is • ^ 

M 

S' to • _ 

£ ' is this alri^tf YES 

7 - ' 

6 ' ' ■ 

1 - _ ■ ' ^ 

NO HST SYSTEM NEARBY 



Can you specify a way in which brie of these 



( 1 j FARliE 
"(E) FARtll. . 
(' 3 ) APARirENTE 

is differerit from the other taq (in a way that matters 

to you now)f ^^^^^^""^fr^^ 

What -is the number next to the DUELLING 

that differs f E, 



You have said.that FARfll 

^F^Rnf ^'""^ '' APARiriENTE 

In not more than three uords each ttmen please describe 
hou the three differ from each other. 
First describe FARIli 

FARni - . ■ 

SHORT BRIVE TO lilOR^ 

TaRMe' """^ ' and APARTtlENTE 

. U>UG DRIVE TO lilORK ■ ^ vr<j 

Are you reasonably happy aith this description ? ^ 



it should be possible to gi\/e each I)li)ELLING_ _ _ 
a rating from 1 to T according to its position 
on the scale 

SHORT DRIVE TO DORK ^ ^.^^^ 

3^ Your rating of FARni 

p Your rating of FARflE! 

q Your rating of APARTHENTl 

4 Your rating of APARTnENTS 

5 to Are these ratlnp OK f NO 

7 ^ 

6 - ^ ; 

H 

LONG DRIVE TO lilORK 
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o 



You can 



( 3r j Cancel this scale (and ali ratings bh it) 
( E ) Change your ratings on this^ scale.. 



Q r-U)hich would yod like to ddf 
'Please type in i-^ or 5 



\ 



u 

G 
O 



O 
O 
O 
Q 

G 
G 
O 
O 



Can you specify a way in which one of these 

t 

• ( 1 )■ FARni 

( E ) APAf?TnENTE 
( 3 ) FARrE 

is different from the other two (in a way that matters 
to you no.w)f Please answer YES _or NO 

What is the nun^er next to the DUELLING 
that differs ^-^1 



Ydu ha\^e said.that FARni » _ 

is different from ' ' ^ cr*Df>n 

APARTMENTE • - ' - and FAKPE 

in not more than three _uords each time-, please describe 
how the' three differ from each other. 
First describe FARMI 

FARfli - — ■ is : 

SHORT TRAVEL Tlf lE TO ijO RK 
On the other har^d-. 

APARTrENTE j . and FARrE - 

[Mg travel Tine: To^m^_ . 

Are you reasonably happy with this description f ^ ^ 

1^ 



YES 



are < 



G 

1 
f 

0 

G 

n 

G 
G 
G- 
G 
G 



3.3.4 Additive Compo#4fe4o»^ule from I^vel 2 to Level 1 Under-Ris^clgss 

If the assuiT^tions 'described iri sections 3.3.2_and 3.3._3 are met, the^ 
following additive conjoint measurement model may be appUed as the composi- 
tion rule from level 2 to level 1 (model l.A; von Winterfeidt & Fischer, 
1975) ; 



n 



n 



x:>x^ iff F(x.) ^ I f^O-^) > I/i^-iR^-^^V 



i=l 



i=l 
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Heri, (x..) scales the atility (part-Worth) of outcbire on attrii^ute : 
dimension 1^ Composition from level 2 to level 1 is achieved by sun-jiung 
the f--(x-) over all n attribute ai!t!dnstons present in the decomposition 
at level^3. However, MAUD ases the slightly different additive contposxtion- 
rule described in section 3.4.4, for the reasons also discussed in sections 
3.4.2 and 3.4.3; 



3.4 MftDT Axiomatization of Se€oii¥>osiJ:lon of Outcomes 




'The decomposition to level -2 described in section 3.3^ while adequate 
for the specification of an additive conjoint measurernent model under con- 
ditions of riskless choice, -is, jihf drtunately , not suf f icient_to guarantee 
the use of an additive composition rule under risky choice. There are now 
two n^jor requirements -that must be satisfied in addition to thos^, required 
for the axiomatization of MAUT under risJcless choice. These are (^^ the 
Satisfaction of the "iure thing'' jprincipie , and (b) strengthening pf the 
value-wise independence apsmnptions . 



3.4.1 The "Sure Thi ng" Ass umption ■ _^ 

' _ under risky' choice, each choice alternative is conceptualized^ai a 
probability distribution over a set of outcomes, that is, as a gamble. The 
sure thing principle, or Savage's (1954) Independence Principle, requires 
that preferences amona gambles should not depend on the values of outcomes 
that are constant in I subset of events. It is essential that this^require-^ 
ment be met in thi EU axiomatization of decomposition from level 0 to level i. 

The sore thing assumption ^ ii not a MAUT axiom in itself. However, be- 
^ cause applications of MSOT involving risky choice require decomposition to^ 
level 1 before application : of the MAUT-axiomatized decomposition to level 2 , 
it is important to discuss the consequences of failure of sure thing checks 
at level 1 on attempted MAUT-axiomatized decomposition^ level ^. 

F^-ilnre^^-Su r^^inq Qiecks in Applications o^^4AUT . There are three 
approaches to the decomposition to level 2, given failure of sure thing 
checks: ostrich-like behavior, reaxiomatization , and forced decomposition 
under an EU axiomatization. 

The rationale for the "ostrich solution" is as follows: B^cause^the 
specification of the outcomes to be decomposed from level 1 to level 2 de- 
pends on the structure of the decomposition to level I' ^^-f^-^^^^^^ 
ktrange the level 1 'decomposition (decision tree or whatever) in such a way 
that each terminal act is associated with certainry with^ a particular^out- 
conie? Then, the rearranged choice alternatives (terminal acts) can be de- 
composed (e.g., by using MAUD) under a riikless MAOT axiomatization, which 
does not require sure thing checks. 

This ostrich-like solution consists of burying one • s head in the de- 
composition from level 1 to_level_2, so that one cannot see what 9°^^ 
on ±n the decomposition to level 1. Apart from all ^1:^°^^^ 
in specifying terminal acts (Brown, 1975; Humphreys, 1979), choice alternatives 
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are cdhceivea xn terms of immediate . courses of action, arid a_ composition 
rule based on an EU axiomatizatibri is required to recompose terminal acts, 
into iiiunediate courses of action; Fail-^^xe of sure thing checks at any point 

invalidates this composition rule and hrnce the whole_ decomposition- 

recbmposition procedure, and the excuse, "itwasn't MAUD'S fault," does not 
solve the problem. The consequences for applications of MAUT are both im- 
portant and ^far-ranging. Decision analysts who think.that conditions of_ 
riskless choice exist in their decompositions obtained thrbugh the use of 
systems such as MAUD should ask themselves carefully whether they are not 
imitating the b^ivior of ostriches by not examining what their clients^ 
actually intend to do with the resulting preference ordering of alternatives. 

In the light of this, one might ask why one has to rely on an EU 
axiomatization of the decomposition to level 1, without question. Such 
reliance becomes necessary only when one accepts that the axioms of decision 
theory shou3:d be treated on a par with the principles of logic _ (e .g^ z 
Marschak, 1968), that is, as principles that are accepted as^not open, to 
rejection following violation. Ailais (1953), Ellsberg (1961), and Slovxc 
and Tver sky (1974) have- raised strong objections tb the sure thing assumption 
being granted such a status because it can lead to some intuitively unap- 
pealing prescriptions about choices and has been found to be_ occasionally 

but systematically violated in studies of sxabjective choice behavior (Tversky, 
1969). If we accept objections subh as these , then the solution prescribed 
by the failure of sure thing checks is to_attempt a reaxiomatizatipn of the 
decomposition tb level 1, based on assumptions more persuasive bn logical 
grbuhds than is Sa</age ' s independence Principle. 

Humphreys (1977, sectibh 3.2.2) has reviewed several such ittempt? at 
reixiomatizatidn, which are generally represented as joint axiomatizations 
of EU (or EV) and risk. However, none bf these attempts has yet met with_ 
sufficient success and acceptance tb form the basis for technology to imple- 
ment interactive decision aids. ^ 



Hence there is no easy way out of the sure thing problem. One suggestion 
(due to Ward Edwards) is that lack of risk preferences can be handled within 
the vMAUD structure by eliciting an attribute dimension of the form 

low risk ' high risk 

foldinb it about the ideal level of risk"^ and assigning it a value-wise 
importance (using standard mOD methodology) relative to the bther_aimensions 
in the decision maker's preference structure. There are , of course, par^U^ls 
to Coo'rhbs' portfolio theory of risk in this suggestion (Coombs & Bpwen, 1971;, 
but it should be remerrODered that here risk is treated as content input into 
the preference structure (as ratings on an attribute dimension) , rather than 
forming any part of the axiomatization of the structure. Hence coherence,^ 
tests for the adequacy of such a conceptnalization of risk in any particular 



^See section 3.6 for a discussion of "folding. 
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situation are not available,, it is: left to the decxs.on ^^J^f f . 
certain that the decision maker's risk preference component _ofhii. or her 
S st^Stu^e for the>l.ternatives -under consideratidH has been adequately 
modeled in adopting this solution. 



3.4.2 Value -wise I ndepenaence Assiimption 



under conditions of risky chOi«, the WCOI and ^?;^^^^^^^f^ 
sumptions used in the axidmktizatxon under riskless 

mus? be strengthened to a Strong Conditional Utility Independence tS_CUIJ 
aSSWion (Rai^fa, 1969) . Keeney U569,__1971) and Keeney^and Ra^f^ 
have called this aiiumption simply utility independence. In formal terns, 
SCUI requires that preferences among'muItiattrii.uted alternatives .O^wh.ch 
I sUbse? of attributes has constant values across: ail outcomes ^^ould not 
depend on the particular level at which the constant values are held fixed. 
It^iuld be extremely difficult to carry out efficient and e^aust we SCUI 
tests in the applications to which MAUD is likely to be dxrected. 

• However, theri is an- easier way out of the SCUI 'problem than searching 
for appropriate test procedures. It followi from the_result that when an 
ScS is satisfied, but SCUI is not, a riskless decompos:Lt:Lon procedure^ 
^V be ised provided (a) that the riskless cohjoint it^asurement^composxtxon 
Se utrnty functions fj (section 3.3.4) are replaced by_utilxty functions 
adeqiati for use under risky choice, and (b) that a margxnalxty ass,^p- 
tion is met (Faiffa, 1969; Fishburn , 1970). , ^ 

MAUD adopts this approach, using a utility ^^-^V^.^^^^^^^""^ 

t-h.^ vie Ids u This procediire is described in the sectxon that follows. 

Swev^r! in dSlngl^is! MAUD assurnes' that the marginality as.umptxo. dxscussed 
next is met. 



3 : 4 . 3 Marginality Assumptiorv^ 



r 



iS value independence (Fishburn 



In formal terms, marginality, alio known as H^.,H^KtTttv 

S Keenev 1974), is^udg^d solely on the basis of the marginal probability 
dxstriSn^ion okr thl single attribute values. ' Von Winterfeldt Fischer 
uKsf dScuss details of this formula: ion and give '.n. following counter 
example : . 

Marginality would require you .o be indifferent between the gambles x and 
V, shown below, because the laaiginal distributions are tne same. 



p^.5 



(l-p)=.5 




4000$ +_a 15' 
Porsche 



lr^61 W 




0$ + a 1373 
Porsche 



4000$ + a 
1961 VW 
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However, most people are likely to prefer i.pr x. This caii be attributed 
to variance preferences^ (Coombs & Pruitt , I960) , because g has a much 
smaller variance than x. 

. . • 

. Failure of Marginality Checks, in Appl ications of M AUT, in applications 
of WAUT i^der risky choice, each choice alternative is a gamble with_a proba- 
bility distribution over the outcomes in the decompcxsition . Margxnality 
checks are %ios't likely to fail in cases in which thie variance of the various 
probability distriblitions is distinctly unequal. In such cases, there are 
three principal solutions to decorrposition ; these are discussed below. 

Reordering solution . This solution (called the buck-passing solution, 
in HuiT?>hreys, 1977) is analogous to the ostrich solution described xn section 
i.4 .1 but may be more successful. The basic idea, is to reorder the structure 
of the decomposition to level 1 so that the relationship betweeh^oice alter- 
natives and terminal acts (outcomes) is described in terms of probability 
distributions with less unequal variances. This amounts to passing the buck 
to the decomposition to level 1, because there is no guarantee that the re- 
ordered decdmposition will pass the sure thing checks just because the origi- 
nal one did. The reordering will certainly involve pruning the decision 
tree', in some cases so severely that the result may amount to cutting it 
off at the roots (Brown, 1975). 

Decision analysts unwilling to undertake such radical surgery; may well 
find it impossible to arrange things in such a way that the decomposition 
to level 1 passes sure thing checks at the same time that the decoiriJOSition 
to level 2 passes marginality . checks . In this case^ the reordering buck- 
passing solution degenerates into an ostrich solution. 

Quasi- additive solution (multiplicative rule^ . Vbh Winter feidt and _ 
Fischer (19T5) describe a multiplicative composition rule that is appropri 
ate for use in assessing utilities of risky alternatives where SCUI checks 
are satisfied but " marginality is not. In theory, this rule may be expressed 
in terms of. transformations of the functions f ^ (x-) in the risk less composi- 
tion rule 'described in section 3.3.f. Keeney and 6aiffa (1976) discuss^this : 
rule (section 6.3), and the assessments involved in its construction and use 
(section 6.6.5). The present version of MAUD is equipped Only with the tech- 
nology required to implement an additive composition rule, but later versions 

will involve the optional use of a multiplicative rple instead. However, 

the multiplicative rule brings with it axiom-checking and assessment problems 
of its own, and a reordering solution, if possible, is usually preferred. 

~ ~ _ _ 2 

^The variance (V) of a two-outcome gamble is .defined as V - p(l-p) _(yi-U2)_ . _ 
where U1-U2 is the difference in utilities of the two outcomes of the gambles. 

^Fischer (1972b, experiment 2)^ , investigating decomposition under risky 
c^ioice, found an additive composition rule to be an efficient prediction of 
-objects' holistic choices among alternative.s at level 1, even m situations 
in which one would expect the marginality assumption to be violated on intui- 
tive grounds. Hence distdrtionr. introduced through the. use of decompositions 
to level 2 with violations o^ marginality, together with an additive composi- 
tion rule of the type employed by mVD, are unlikely to be serious when n-WCUI 
checks are satisfied. 
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3:4.4 Ada4fe4v^bmpo5tti6n Rule from fe vel 2 af.a i^vel 1 
Unaer Risky Choice, 
Given that the appropriate value-wise independence assumptions have _ 
been S^! W^ Sy use the following n^del "as the conpositxon rule from level 
2 to level 1 under both ri^Jcless and risky choice: 

X. > )C iff U(X.) d I u.(x .) > j ^^^±k' = "^V 
D " ^ i=l 1=1 

Note that for a«y x,., u^^..) is monotonic^lly related to f.U..) (Raiffa, 
1969; Fischer, 1972aj. ; 

- - "to nqpfui in applications of MAOT under both risky 

i c nOinDOSltlOn rule -'^S USeiUX XIl a^^-'J-J.^-" -. 

portance assessir.ent techniques Dasea on a ^^v :^ ^^^^^ Fiqcher 

Lttery Ticket, or BRLT (Raiffa, x965, y. von Winterfeldt ^ ^J^^^er, 

Sts- Humphreys S Humphreys, 1975; Keeney S Sicherman, 1975,_p. IQ 1?^^ 
Jt 1^ S st^aard co^osition rule used in the current version of MAUD. 

Given a scaling procedure that yields attribute values giUi.) , mpg^^ 
, 7, , . f^, ,^ {section 3.3.4) , and hence to Ui (xij^) , a BKbi 

tonically related to fi tXx,) isection ^.j,^ directly. The relation 

based proceaure may be useS to construct the n^i^i^) directly. 



is of the form 



■'u.Cx^.) = {g^(x.j) where = 1- 

the X. assessed by BRLT-based procedures are in fact products Of^ 

Relue-wise importance weight] x [relative scaling factor] 



V [f to u. correction] 

h-. 
1 



Hence, in separated form: 



u.(x. .) = w.q.h. [g.(x.j)]. 



Pro. . .on joint measurement Point of view, the se^-pj^not bl asSessi^^ 
is both unnecessary and vacuous, since w^ , , ana 



r 
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separately fr5S 5ne another. Hence the prdeedare;used by MAUD for the as- 
sessment of l^^^ does not attempt" any such separation. 



3.5 Mapping Between - Level 2a and Level' 2 



In applications of MAUT , data are usually collected in the form ^ of rat- 
ing of attributes of outcome^ on arbitrarily scaled rating scales 
current version of MAUD uses ah arbitrary Seven-point scale on all attriBute 
dimensions.) .Before such data ca^ be used in MUTjcompbsition rules, they 
must be subjected to two napping trans fprmations, folding and relative scal- 
ing, which are described in sections 3.5.1 and 3;5.2. 

Since both the raw rating scale' data and the transformed data are repre 
sented at level 2 in the decoiuposition scheme, the two forms of dpt^ ar%,_dis 
tinguished here by describing the raw data as represented at level 2a ana 
the transforired data at level 2. ■ ■ 

3.5.1 Fo^ldi nq J-Scales 

AS an example denonstrating the need for _ folding transfSEmationi of 
rating scale data, consider the 

decide which of several potential companions to take to a dance. One of the 
attribute dimensions used in the decomposition of Outcomes (companions) 
might be 

degree of boldness 
SHY BOLD 

( _ t. 

ideal point 

This attribute dimension, as represented here, is scaled monotonically be- 
SSSn the two- poles SHY and BOLD, but the most_preferred point on^this at- 
tribUtrdimension ^or most decisionmakers in this situation, would be some- 
where in the middle. Clearly, no monotone transformation of scale values 
on a SHY-BOLD rating scale can yield g. (x..) appropriate for use in MAUT 
additive composition rules. 

coombs (1964) has Called such scales, and all physically represented 
scalis J-scales, where J stands _for joint-shared across individuals. In 
order to transform any .^scaled dat. ^^-^^ - ^ ^^f^^ Scale 
into a form suitable for use as- _gi(xy), one must ^^^;J^^^ 
about that individual's ideal point on the J-scale (Cooittos, 1964, Dawes, 



Described in section 3.6: 
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1972, ■ Section- VI. 2) . lUis yields the decision mkir's individual preference 
scaling of the attriBute dimensions and hence I-scaled data. 

The following example shows MfiUD folding a J-scale in interaction with 
a decision maker. 



0[ . _ ^ 

iSIRLS undGP consideration 

(1) NANCY ___ 

(E) CHARLOTTE 

(3j MARY 

(M) HELEN 




o 



G 



O 



Can you specify a way in\ which one of these 

( 1 ) NANCY 

( E ) tlARY 

( B ) CHARLOTTE 

is different from the other two jin a way that matters 
to you now)f Please ahswer_YES or NO 

What is_the riumhs. next to the GIRL 
that differs f E 




You have said that MARY 
is different from • 
NANCY 



and 



CHARLOTTE 



In hot mre tFian three words each time-, please -describe 

how the three differ from each other- 

First describe MARY 

MARY, . is : 

On the other handn _ _~ 

fjANCY ' CHARLOTTii 

Afi~"yoa reasonably happy with this description f Y|S 



are: 



Q 

d 

G 
O 
O 



^^^dte that the use of an additive composition rule from level 2a_iJ-scalea 
attriSuSs) to level 1 -(OUtcern^s) will violate the HAUT mdhOtonxcxty assui^p- 
tion (section 3.3.1) unless the ideal points of all decision makers under ^ 
c^nsidlr^tion are located at one or oth.r pole, of all the J-scales on whxch 
the attributes are represented. 
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EKLC 



0 
O 
0 
O 

o 



It should be possiW..eJbo give each GIRL _ _ __ 
a rating from 1 to i' according to its position 



on the scale 
SRY 
1 
E 

3 ^ 

^ 

5 to 

b 
B 



Your "rating of NANCY ' 
Your rating of CHARLOTTE.^ 
Your rating of 'HARY 
Your rating of HpLEN 
Are these ratings OK f YES 



is : 1 
is : E 
is : ^ 
is : 5 



o 

0 
0 

o 
o 
o 

0 

o 

0 



Thinking only about the sca^e below-, what position 
on the scale would -you like most of all for 
an IDEAt GIRt 
SHY 
1 
2 
3 

5 to 

b ^ 
7 
S 

BOLD 



Your best possible value is : 5 
is this' alrightf YES 



you specify a way in which Lone of .these 
( i ) CHARLOTTE 

( E ) NANCY . . 

( 3 ) .fiELEN , 

V • 

is different from the other" two lin a way that matters 

to you npw)f Please answer_YES or NO) 

What is the number next to the GIRL 
that; differs f 1 . - 



YES 
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o 
o 
o 
o 

G 



You h^vZe said_that HELEW 
is differGht from • 
CHARLOTTE ' 



and 



In not moPG than thr^e words each^ pleasG dGScribG 

hbw- thG threG diffGP from each othGr- 

First describG HEtEN 

HELEN _ is : 

NOT SEXY 

Oh the other handi' 

CHARLOTTE and NANCY 

SEXY • ' 

Are you rGasonably happy with this description ? 



are ■ 



O 
O 
O 

Q 
Q 



The rollowing extract from the" log resulting from the session showshow 
MAUD used this' information in foldiiig the J-§cale ratings to. produce i-scaled 
values. * 



O ( ATTRIBUTE DIHENSIONS tiSE© 

, (i) SHY (1)..^. ..TO. BOLD (^) 
O \_ I])E.AL VALUE = S 

, tE) NOT SEXY il) .^....TO.......... §EXY (T) 

O / IDEAL VALUE = T 



o 
o 
o 



o 
o 
o 



RATINGS OF GIRLS ON 'ATTRIBUTE DIHENSIONS 

GIRL i a 3 R 

ATTRIBUTE 

DIHENSION 

(1) ; T.QD fi-QQ 1-00 S.DO 

VALUE .□□ -25 .00 

(B) T.DD 7.Q0 E.QB LjD 

VALUE i.QB .75 .13 ^ 



3.5.2 Re-l4 



ling 



Construction of I'§cales on all attribute dimensions insures that, the 
numbers assigned to attributes on each dimension, will be monotonic with worth 
on that dimension,- but it does not . insur^. that the scaling metrics o^ill be 
comDarabie across "dimensions. Ma}:inc scaling inetrics comparable . across di- 
rnensions involves operations called relative scaling (Raiffa, 1969). 
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The uie of assessment techniques based. upon BRLTs such as -Chat ased in 
MAUD, effectively carries out relative scaling simultaneously with the as- 
sessment of value-Wise importance of each dinension. In this ca^, r%,S"« 
not need to consider separate techniques for relative scaling. The values 
assessed in BRLT-based procedures are suitable for direct confcinat ion with^ 
I-scaled attribute values, providing that the Xi values were assessed^ on the 
same I-scales as the attributes themselves. However, some direct methods 
for 'assessing Value-wise importances of dimensions do assume that the values 
of the attributes on the dimensions . fully . relatively scaled. Procedures 
attempting to accomplish such relatiV^Scaling are discussed in Hunphreys 
(1977, section '4.2) but are rather complex and not currently available in 



MAUD. 



3.6 Eval-ttation of Algorithms for Compositio n Rules 
from L evel 2 a to-I.eveJ^ 

'' ~ " - ' - 

Lcations of MAUT, a single algorithm is usually employed to im- 



e:^licated parameter values in which the decision analyst^has to 
decision maker directly or indirectly for all parameter values, and algorithms 
making use of oDserver-derived parameters, usually v^ith the help _ of mylti 
variate statistical analysed. MAUD Uses exclusively client-explicated 
parameter values^ and only algorithms making use of such parameters ?^e^ex- 
a.-ninid here 12 The input to each algorithm is assumed to be scaled attribute 
Values gi Cxlj) , and the output to be the Utilities of the outcomes, Ui. The 
notation is that presented in section 3.4. -. 

3.6.1 Additive Rule: BRLT-Basea-^As^essffient Mei i ho ds , 

This alqorithm uses the additive _ composition rule 'under risky choice 
described in section 3.6 and is the algorithm used by MAUD. The attribute 
values gHx,,) input to the prdcedures must be scaled on ^-scales (^^ction 
3 5 1) Value-wise importance weights, relative scaling factors , and. the 
f • to u+ corrections are determined simultaneously in compound form by _ the 
B^T-based procedure. Early examples of appiicationB using this algorithm ^ 
are the' following : evaluation of hypothetical cojmpact cars (Fischer, 1972b) , 
evaluation of apartments by students (von Winterfeldt S Edwards, 197 3a) , and 
the evaluation of cinema films (Munphreys S Humphreys^, 1975)^ In e|ch of^ 
these applications, algorithms Using the BRLT-based procedu.ve were found to 
be at least as good or better thitn 'algorithms in predicting holistic evalua- 
tion of outcomes. 

This algorithm forms the basis for the assessment of value-wise impor- , 
tance weights within MAUD. .On theoretical grounds, this technique is „. 
preferable to simpler ranking .^d direct rating techniques, such as those 
dis.4sBed'in section 3.5.3 ^d Sdwards' tl977) SMART technique because the 



^^See Hober, 1974a,b, and Humphreys , 19 77 (section 5.2) for calculations of 
algorithms making use of observer-derived parameter values. 
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latter do riot compensate properly f5r relative scaling factors and ffius are 
vulnerable to distortion of assessed weights due to use in inappropriate 
anchors and scales b^" the decision maker; Despite this, Raiffa's (1969) 
original BRLT-based ^thdd is little used because it requires a large num-^^ 
ber of complex trade9ffs to be made between, both .abstract quantities (K^^^^ 
reth et "al . , 1978) . ^he.procedure used within MRUD is computationally much 
la^re sophisticated th^ Raiffa's but provides a much ^inqpler and shorter 
presentation to the us^r and requires much fewer and simpler assessirents • 
Iri fact, within a preference structure comprising N attribute dimensions, 
the decision maker has. to make only N-1' simple indifference judgments , 
fewer ratings than with ariy other technique, direct or' indirect. 

MAUD uses its coxr^utational to construct a streamlined .set of BRLTs , 
each c5mparing tradeoff^ on only two dimensions but organized within a_ 
hierarchical-^free structure formed through a cluster analysis of attribute 
dimeijsibns. ft minimm information transfer algorithm is applied within the 
I-scaled decon^osed preference matrix to construct a^ cluster fusion tree 
•with two branches at each node. The tree mderlying the BRLTs presented in 
the demonstration sessibri reproduced in sectrion 2 possesses the .structure 
shown iri Figure 2. ^ _ 





Figure 2. Hierarchical fusion tree for attributes represerite;^. in the. 

decomposed preference structure illustrated in section* 2. 

i _ - ; . . . ^ 

IJote. Trie (nondeleted) attribute dimensions fused iri this 
structure: were ; , ' 

1. Pick up situation ... to ... Established couples. 

2. With better jokes ... to Mth boring jokes. . 
Uninterrupted ^logari . to .... Interrupted slogan. 

7. IrWblvirig^ . . . to ... Not involving. 

8. Appealing' to boys ... to ... AppealiYig to boys arid 



4 



girls . 



\ 



The BRLT technique is us^d afeach of the N-1 nodes in the N- attribute \ 
fusion tree to compare the^-i^Ubsets of dimensicris , connected at that no;le . 

' computation of X values for each dimension on the basis of the lottery^re- 
suits is then analogous to the computation' of probabilities of terminol _ 
events in a decision tree. Many possible trees can be formed to link a set 

^ of attribute dimensions. Zu theoretical terffis^ all are equally suitable ,^ 
but it is desirable to construct a tree in such a way that it minimizes the 
Effect of any violations of value-wise indeoendence 

40 ' X 



The clustering procedure used by. MAUb clusters first tiidse diinen 
or sets of diinensions, that are most highly associated. This clustering 
procedure possesses two merits; First, in any node, the set of dimensions 
being compared are more highly associated than any possible combinations of 
dimensions that' have not yet been considered. Thi^. helps to generate stereo- 
type items that, seem realistic to people^ Second, t/ie requirement of weak 
conditional utility independence is optimized. It is important to insure 
value-wise independence between branches, connected at\the top of the tree, 
because incorrect estimates of k here will affect the X calculations for 
many more dimension^ than will incbrrectj: estimates f o|x^brancHes connected 
lower down. Note that as one moves up the cluster hi^ei?6rchy, the degree of 
association between the iets of dimensions clusteretf at each node decreases ; 
thus, hopefully, the lotteries estimating X -weights, involvirig larger numbers 
of diinensionsjiave the greater chance of meeting the value-wise independence 
assumption. The structure of the tree is not visible to the >ser but is 
used to direct the sequence of the BRLTs presented by MAUD to ^the user and 
the conversion of the probabilities t±ius elicited from him- or her into the 
relative iitfeortance (X) Values and the preference (holistic utility) values 
of items under cbnsiderationi The following exairple describes .the construc- 
tion of the sequence of BRLTs illustrated in the session with MAUD described 
in section 2 . 

^ _ 

Consider the first BRLO? constructed. This example contrasted attribute 
dimensions 1 and 2 by constructing three stereotype alternatives defined in 
terms of their extreme positions oh the two-attribute dimension. 



Alter^^ive I 

A cola ad. 
which scores as 
'high as the best 
alternative (Fish 
and Chip Shop) on 
attribute dimension 
1 ,fwith better jokes) 



AND 



which scores as • 
high as the test 
alternative (Fish 
and Chip Shop) on 
attribute dimension 
2 (pickup situation) . 



Alt e rn a t i v e- ' 1 1 

"A cola ad. 
which scores as ^ 
hijh as the best 
alternative (Fish 
and Chip Shop) on 
attribute dimension 

1 (with better jokes) 

BUT - 

which scores as 
low as the- worst 
alternative 
(Bermuda) on 
attribute dimension 

2 (established 
couples) . 



' Alternative iii 

A cola ad., 
v^ich scores as 
low as the, worst 
alternative 
(Bermrtda) on 
attribute dimension 
2 (vsrith boring jokes) 

AND 

which _scores a^ 
low as the worst 
alternative 
(Bermuda) on • 
attribute dimension 
2 (established 
couples) . 



Alternative I is- a 
which the best alternat 
of the two dimensions. 

Alternative III is 
which the worst alterna 



best cola ad stereotype, anchored at the point at 
ive within the set under consideration scores ..on each 

a/vv-orst cola ad stereotype, anchored at the point at 
tive within the set under consideration scores on each 



_ 

Of 'the tw8 dirnensions. Note that xnthi-s example Fish arid Chip Shop hap- 
pened to be best on each of dimensions I and 2, and_Ber«a<ia happened to be 
w^rSt on each of dimensions 1 and 2. ".If this_had not ^''^^^J^'^^'' 
pL'ty had scored best on. <aimensidh_2 , and Hair worst) ,^then 
a±ternatives would have been used as anchors on dimension 2 instead. 

filtertiative II is a compromise alternative, anchored^ the best point 
on atmensiSn 1 but at the worst point on dimension 2,. 

NOW luppbse you had to choose between two optioHs. 
ouararitees your comoromise alternative II for s^e, ar^d the other option _ 
I! gSes you TchanceJ^f getting b.st alternati* I, ^^J^jf ggj^^' 
or worst alternative III, with probability (1-p) as shown in Figure 3. 

\ botion A 



on B 



X Optiop A 

' . (sure thing) . (gamble) 



Alternative 



Alternative II 
' for sure 



1-p ^^Alternative III 
Figure .3. BRLT for attribute dimensions, 1 and 2. 



It follov^s from expected utility theory.that if a value^p isjognd for 
^ioh you are indUferent --en t>. option, J^-^^B,^then^the^^io^oJ 

^^J'rV.^^f^^^^^ls ke^o^Fishburn. for its deri^fation. 



the two .dimensions. (This result 
see Raiffa, 1969, pp. 35-6.) 



kuD uses descendix>g_and ascending-ethods^of li«its_ (starting with^a 
nding serJ 

n!S'-'"2rtence^^r= -^^ ^ ^"^^25, subiect_to_the cOri.t.aint 
1-p) _ .25, hence constructed a BRLT^ for dimensions 



descending s i^ trfindlRislndifference^pointJor ^e BK.T . as illus 
trated ^'section 2.10. In th. es.n^le, ^his occurred^wher^ P = • S and 



X + = 1 Similarly, MAUD next construcT:ea a ci^.^^^.^^ — 
4 and 7 yielding = -15 and = . 85 subject to the constraint 
t,r.5'/l!ShI t^ird B-T.as -cate^at the nod.in f^^^^^ 

SerS^vri^JStSnr: com^osS of dSensfoL . and -J.^^ension that^ 
r^clived the highest A weight wShirl this pair , i.e. , ^dimension 7 ,^is chosen 
as a delegate for this cluster in thW BRLT, yielding - .55, - -45, 
subject to the constraint X7 + Ag - 1. 

it is the delegate. 



A2 



f-lAUb therefore maXes the appropriate cbrrectibns be fore pr^ 
the next BRJT, where the' results aire siinilarly correctea , and so on, until 
all N-1 BRLTg have been assessed and ail N X values determined, under the 
_ _ N ^ . , 

constraint = 1. : 



The" final version of tJie tree, with (uncorrected) assessments and in- 
terrnediate delegates filled in, appears, for this example, in Figure 4, 



delegate for 
(4+7+8) 




Figure 4- Final version of tree. 



After the appropriate ' ridrrtializations and corrections, the assessed X 
weights constructed from the data represented in this tree are as follows: 



8 



.026' 
.079 
.079 
.44 8 
.367 



weights are shown inthe summary of the MAUD ; session^ reproduced in 
2.10, together with the holistic _ utility values of alternatives com~ 



These X 
sectibn 

puted through their use in an additive MAUT composition rule. 

M ulti-plicative Rule: BH£T"Sased Assessment Procedure . ^This rule and_ 
its use is described in Keeney and Raiffa (1976, chapter 6>. The multiplica- 
tive rule is used irf cases in which the Xj^ assessed by a BRLT-based procedure 
do not sum to 1 over all n attribute dimensions (i.= 1 to n) From a con- 
joint measurcirient standpoint, this use of _ a multiplicative rule_,is_ a- pro- . 
cedaral device to simplify computation.. Logarithmic transformation of both, 
sides of the equation are used for the multiplicative forms of the composition 
rule according towhich is most convenient to _ use , given the nature of the 
data tad the decision-making situation. In situations in which the Tesult 
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of obtaining a worst vilue on a particular attribute dimension x^^so^severe 
that this wo^st value is not cbinpehsatea by best values and on all other 
SSiSute diH^ensioni. then one's best strategy is either (a) to use a mul- 
SplSative for. of th. composition rule, which Will_ a.lete -■^J. 
Sit possess such a value through multiplyihg them by zero, or ^, zo delete 
Si s?ch outcomes as nonitarter. before using ^ ^^^^^^ . ^^J,^'" 
in the evaluation of the remaining outcome s._. Strategy b xs the strategy _ 
reconSended for use with MAUD, although. a multiplicative procedure will^be 
implanted in future versions of MAUD_ to deal with residual problems where 
marginaiity is still not satisfied (see section 3.4.3). 



3.6.3 Non-BR£T-Based- Assessment.- 



hold in his or her mi 
make accurate cons5arisons between them 



BRLT-based methods, vSile theoretically optimal, have the disadv^tage 
that, Sth the eSeption of the methods currently used in MAUD, they /equire 
Some extremely coitplex aiiessments "from the user. In order to compute a set 
oTl Sghts/eitSr a larg. nun^er of simple lotteries or a; ^^^^^^ 
of increasindlv complex ones are- usually employed^ requiring the user to ^ 
of _ increasingly _comp_^^ descriptions of quite complex stereotype items_and 

If n is greater than 5 or 6 , the 
procedure becomes unwieldy, and the user usually begins to complaip_of in-^; 
formation overload when required to n^Re comparisons. In view of this prob 
leJtT Some alternative procedures considered by decision^ analysts are^dis- 
cassed below. They are theoretically suboptimal, -^--^l^^ - ^^^^^^^^ 
ease of use. They are not employed in MAUD, however, where we took the al 
ternative route of improving the optimal procedure. , 

bomoensatior Methoa, This algorithm uses the composition rule under 
riskl firS^o^ce de^S& in section 3.3. It has been used by von_Wlnter- 
fildt Ld Edwards (i973a) and Aschenbrenner (1975), in both ^^^^^^^ 
Lstn^tion 'of anartments by students under riskless choice. Von Wmterfeiar 
Sf iSds deSiS the .method as a "direct rating procedure with ^impor- 
Ta^cfSghts -derived from the unstandardi.ed utility functions as described 
brs^yekt. (1972) in the framework of additive con30int measurement. 



In this procedure^ 



each X' ^ (^w^qi) is det^rrninea by observing how much 



the decision nt^er's holistic U. ratinis change v)hen values of their (hYgb- 
the.aecision .uct^t^ j ^ are changed from worst to best. , Con- 

on dimension 1 • 



thetical)' attributes on dunerisidns 
sider the effect of switching from worst 



. Sccording to "the conjoint iheasurenent 



(0) to best (1) 

model described in section 2.6, 



i=2 



X' :g(x. .) 
1 13 



+ x^ (1) 



I 

i=2 



X' ;g(x. .) 



X'^(O) 



= X' 



Ail other at- 



where. AF. is the^ange in^the holistic rating of , outcome 
tribute dimensions are similar. 

Aschenbrenner-s^rsion of the _procedure_starts with attributes on all 

dimensions St their ^Trst value, jf.el. 
She had the opportunity to change 

which one Would he or she choose? He assumed that the attribute chosen 
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Will be thit which inaximizes fiFs; ' The qaestion .is.regeated until allattri- 
butes have been dianged to their best Levels arid all dimensions ranked in 
teirtiS of the value -Wise importances. The X-^^ are then formd through di- 
rect rating of the importance ratios of the attributes. 

As with BRCT-based assessment methods, the gi(Xij) input to the model 
mast be scaled on I-scales, and value-wise independence is assumed. However, 
x^like algorithms employing BM-T-basea assessment techniques, this algorithm 
is not appropriate for use. under risky choice, because fj to corrections 
(h-) are not determined. Von Winterfeldt and Edwards a973a) found the com- 
pensation method to be inferior to a BRCT-based assessment method but superior 
to a direct rating method. 

Direct Rating Method . In typical applications using the direct rating 
method, the value-wi§e importance weights are assessed by asking the 

decision maker for direct ratings. Formaliy, algorithms making use of «iis 
procedure require also the use of a relative scaling procedure to estimate 
values of q^ (section 3.4.4), because under the riskiess choice fi(Xij)= 
'wq.[g(x- •)]. However, in most applications of MAUT in which direct rating 
tichniquei have been used, the qi have not_been assessed. SUch applications 
have included college admissions (Khlar, 1969)_,:_eValuation of medical care 
research proposals (Guitafson et al . ; 1971) , -evaluation of military tactics 
(Turban s Metersky, 1971), and othars reviewed by Ruber (1974a). _Technically, 
the additive models used in these applications are incoherent, because values 
of fi(Xi^) or Ui(Xn) cannot be assessed in the absence of values of qi- 
,„^...„,-.„v:^*:v,^„ hi m^riS coherent bv adding the constant scaling assumption 



.However, they can be made coherent by adding 
qi = 1 (i = 1 to n) and then applying an additive composition rule. 

The constant scaling assumption seems to be reasonable in many applica- 
tions of MAUT, because direct rating models incorporating this assumption 
have often perforrred quite well in 'practice (Dawes S Corrigan , 19 74 .. Huber, 
1974a). AS would be expected, _though , their predictions are inferipr t^^ 
BRET-based models (Fischer, 1972b; Von Winterfeldt S Edwards, 1973a) The 
apparent efficiency of these models is due in part to the f act _that they _ 
have been used in applications in which the constant scaling assumpjiion is 
reasonable a priori. As a counter . example , consider the evaluation °f Pro- 
prietary brands of sweets (outcomes) on the following attribute dimensions: 



1. Not tasty ... to ... tasty 

2. Poisonous ... to ... not poisonous 



value-wise relative 

importance- scaling factor 



■ ' Direct rating of value-wise importance -would, for most people, yield 
wi < Wo because preservation of life is more important than having a nice 
taste in your mouth. However, cji > q^ , because attributes of proprietary^ 
brands of sweets range right along dimension 1 but are all squeezed together 

at the preferred pole of dimension 2. When we consider the products _ 

"iq± = fi' we car^ see that attribute values on ci±,T;ension i will dominate 



the analysis only if "^y^"^! 



q2/qi. 
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Ec mal Weights . Method . This rnethdd is liJce the direct I'ating n>ethod_ 
excepFThat an additional eqaal weights assumption = W2, . .Wi- . . - w^, is 
mide: Hpnce value-wise importance weights need not be assessed _The re- 
sulting model is that underlying the Likert scale techn.qu^ used .n^a_vast 
nuimer of attitude and personality scaling applications {Edwards, 1957; 
Dawes 1972). Hespite the strong and arbitrary character of the equal 
weights assumption, such models hayi been found quite efficient in_KAUT 
applications (Dawes S Cor rigan . 1974) . although inf erior^tP^ a m^del usang^ 
a BRLT-based assessment method (Hun?>hreys S _Huii«>hreys , 1975) . Einhom and 
Hogarth (1975) delineate the situations in which equal weights methods can 
always be improved by combinlrig them with appropriate prior information, 
asing BRLTs is one way of gaUiiJig such prior information. One ^reason for 
Uie apparent efficiency of the equal-weights model may be.the demonstrated 
iniensitivity of additive model compositions to Variations in the w- value, 
(von Winterfeldt S Edwards, 1973b) . , 

MAUD can provide ah equal weight option that allows a user to examine^ 
his or her preference structure and the computed holistic utility values of 
alternative items within this structure before (and without) having t9_m^e 

assessments within a X-Weight estimating .procedure. ; l^is Option is con- 
verien. but can lead to misleading results when ^^^"■^P^^^"! ^^.5-^^^^^,^° J^^" 
ing Sd equal weights are infringed. It should therefore be used with caution 
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APPENDIX A 



PROGRAM DbCUMENTATiCX^ 



MAUD is written in BASIC for the IBM 5110 system, using the display 
screen for input and output. 

Lon on the IBM 5110 



The screen.is treated as a record I/O file. It Is opened using the de- 
vice number *002'; 



e.g., 0075 CPENFILE FL5 , 'OOilSALL. 

. Where Ali specifies both read and write bperatibhs: 

The system allows manipulation of the top 14 lines of the. screen , with 
a maximum of 64 characters pe-r ii^. Data can be written. on the screen using 
WRITEFILE or REWRITEFILE statement^ and read using the READ statemen^. ^When 
addressing the screen, the^ first character position and the length of^the 
I/O string both have to be specified. When necessary, the final positron of 
tlie pointer can also be specified; 

e.g. , 0225 WRITEFILE_ySIJWG 130 ,FL5 Title for this session' 
0130 FORM_PDSl29,C25-,PO|i54 _ 
• 0140 READFIEE USING i5d,FL5,f? 

0150 FORM POS154,C60. 

The Internal Layout of MAUD 

MAUD conprises three programs: 

" MAUD—is the main program. it el icits choice alternatives ang attri- 
bute dimensions. -In addition, it -also ^checks ratings of alter- 
natives ort' dimensions and elicits ideal points on each ^xmension. 

BRCT—computes lotteries for assessing value-wise_iiT^)ortance of dimen- 
sions, computes preference values for choice alternatives, and 
cdmputes cluster correlation. 

LOG — produces a hard cbpiy of the summary. 

Data Files 

MAUD has fbUr data files: 

Fi~stores titles and control values. 
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• F2-ito^es a matrix coritaintng the names of choice alternatives and 
two other _matrixes containing the pames of poles of attribute 
dimensions. 

F3 — stores control values: 

' F4--stdrGs data. The file is three records long. ,. 

Fl, F2, and f3 are sequential files. ^ey can be accessed by using an OPEN 
stajternent ; ■ 

e.g.; OPEN FLl / E80 ',4 - Fl MN , lOERR 6990 . 
FR is a -record-oriented fil^ It is accessed by using the OPENFILE statert^ilt; 

e.g., OPENFILE FI^ -E80 7 , ' F4 MN , lOERR 6990. 

. Details of Fil^ Storage- 

Fl contains seven variables. 

T$: title of tlie session (maximum 60 characters long) 

S$: generic name for all items under^ consideration in^ singular forrn 
(maximiam 30 characters long) 

P$: generic name for all items in plural fdrin (maximum '30 characters 
long) 

J: number of attribute dirnensions (J-^^ --20) 
Nl: number of choice alternatives (Nl^^ = 8) 

N2: nuiTtoer of successful mappings of attribute dimensions 

(N2 = 8) 
max 

k2 : error flag • 
F2 contains three matrixes. 

A$: contains names .of choice alternatives ^(maximum 30 characters 

each) 

B$ and C$: contain poles of attribute dimensions (maximum 30 characters 
each) 

F3 holds seven matrixes. 

H; status codes for. attribute dimensions (negative if the dimension 

has been deleted) 
S: standard deviatiSns of ratings on attribute dimensions 
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B: positions of ideal points on attribute diir.ensions 
W: weights of attribute dimerisibris 

U: utility values for items (range between 0 and 1, negative if not 
yet.' CO input ed) - 

L: lists of branches of nodes in utility hierarchy 

f _ -- - 
sums of ratings on attribute dimensions 

F4 holds three records cdnsisttng of a single matrix each. 

Z '(record i) : stores. the ratings of choice alternatives . on each attri- 
bute dirnerision (values are between 1 and 9) 

X (record 2) : stores the value of each choice alternative on each at- 
tribute dirrehsidn 

R (record 3) : stores the correlation coefficient between attribute 
dimensions 

Details o n MAUD 
MQPtJLE 1 : 

Lines 195-795: Parameter used -_Nl (which counts the nuiriber of choice al- 
ternatives under consideration, Nljnax " ' 
This module deals with input of title_ _(T$)', ^ generic name : 
in singular form .(S$) and plural (P$) , and choice alter- 
natives. (A_$(I)~where I is an index between 1 and Nl) . 
Line 520 checks that Nl is <= to 8.. 
: Finally^ the module displays all the choice alternatives 

entered by the 'user . 
* End of module. 

MODULE 2 : 



nines 300-1165: Parameter used Nl. _ . 

Lines changes (if any) in choice alternatives 

Lines 880-99d_change the name of a choice alternative . 

Lines 995^1095 delete a choice alternative. . . 

Lines 1100-1165 add a choice alternative to the list.. 

* End of module. 



MODULE 3 : 

Lines 1170-1820: Parameter used - J (which counts the number of attribute 

: ^ dimensions , J^ax ' . -- _ . - 

. • This module -deals with elicitation . of attribute dimensions 
poles (stored in B$(J) and C$ (J) -"Where J is the index 
of each attribute dimension): 
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N«DDUI£ 3 (continued) 



At line 1270, the nodule calls a subroutine:, RANDOM TRIAD 
GENERATOR (lines 5375-5420), which randomly picks out 
triads of choice alternatives and stores their inde;:es 
in a G array (G(i) 1=1 to 3) ^ _ _ 

Lines 1285-1320 present those three alternatives and 

stores them in an X$ array (X$(I), 1^1 to 3) . _ 

Lines 1580-1820 elicit the attribute dintension. Each di 
mension consists of two poles, i.e., B$(J) and C$(J). 

^ End of module. 



MODULF. 4 



Lines t830-220b: Parameters used -^- Nl and J- - - ^ - 

This module elicits values of z(i.,J)— between 1 and 9, 
where I is the index of each choice alternative' (I-l 
to Nl) ^d J is the index of the current attribute 
dimensibh being assessed. 

* End of rtradale. - : 

mPULE 5 :' 

Lines 2220-2525: Parameters used J and H(J). -^^^y- 

This module allows the user to make alterations ^by either 
changing the ratings or canceling the scale _ aitogether . 
Changes are dealt with by a subroutine: CHANGE RATINGS 

; (lines 8270-3410). _ _ __ _ ^ 

Changing the scale will take the user back to the previous 

rnbdule. _ _ . . . _ 

Canceling the scale will toke tha user back to MODULE 3; 
the status, H(J) is assj.gned the value -299.. 
■ If there is no alteration to be made, H(J). remains 0 and 
the program carries on to the next module. 

* End of module . ^ ' ■ 

MODUI^ 6 : 

Lines 2530-2895: Parameter used J. __ _ _ _ _ ^ 

This module elicits ideal points for each attra±)ute di-_ 
merisidn J with poles B$ ( J) and C$ ( J) . .The vai^e of the 
ideal point is stored in H(J)— where the range of the 
scale is between 1 and 9. 

* End of module . 

_ ^ 
MODULE 7: 



Lines 2920-2933: Par^eters used - J and H( J) . ^u^'^^^t^o^ of the 

This iTVDdule allows the user to . change the ratings of tne . 

ideal point (B(J)) or cancel the entire scale. ( 

Changes are dealt with by the subroutine: CHANGE RATINGS 

(lines 8270-8410) . _ 

Changing the rating will take the user back to the previous 
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jO-lVJIuE 7 (continued) 



Canceling the 5ca±e wi±± take the user.back_to MODULE 3; 

the status, H(J) is assagnecS the value -299. 
* End of module . 



Lines 30S0-3190: 



Parameters used Ml and J. _ ' : 

Values of X(I,J) are computed, i.e., values of each choice- 
alternative (1=1 to Nij on the current attribute dimen- 
sion being assessed. i 

Lines 3140-3185_adjast_the scale such that the worst 
valae=0 and the best value=l . .... 

If there is very little variation (i.e., < .5)^ 

all values of X(I,J}, the program will pa,ss on to the 
next module; otherwise it will proceecS to MODULE 10* 

* End of module. 



MODULE 9 : 



Lines 3200-3390: 



Paraifi^ters used ^ J and_H(J).. _ , 

This module becomes active when there is_<. 5 difference 
between all values of X(I^J)^. It allows the user to 
do one of the following three operations: 

c 

- change the values of Z(I,J)^. 

This will take the user back to MODUI^E 4. 

- change the value of B(J) . . 

This will take the user ba.-:k to MODULE 6. 

- change nothing.. __ _ . 

The _status^_H_(J) is set to -99 and the program pro- 
ceeds to MODULE 11. . ^ 

* End of module . 



MODLTLE 10: 



Lines 3395-40.40: 



ra::ameters used Nl , J ,H ( J) ,N2 , and Kl . 

The variance, S ( J) is computed and the current status, 

,H(a) , is set to 1. 

If N2 is <2, the program willvbypass the re:'t of the module 
and_pass on to the next module. _ - - 

Line 3515 computes the value of r]m,J) , where, M is an index 
between 1 and J-1 , and J .is the index of the current 
attribute dimension, which at this stage must be > 2. 

If the current R(M,J) is <.866, the next valueR (M+1 , J ) 
is computed. When all values of R(M,J) have been suc- 
cessfully computed, the program passes on to the next 
module . _ - • 

For each R(M.,J) which has a value > .866, the following 
process -Is activated: - 
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Lines 3530-3745 check, with the user whether ornot a change 
is Required. If the response ±5 negative^ the program 
will_increrrierit M by 1 and cSit^ute the next value of 

R(M,J) . - - - ^ 

If the response is affirmative (i.e.^ the two attrohute 
diinensions being analyzed have similar meaning), the 
following submoduleis activated: . , 

Lines 3755-4040 conduct a constructivist solution. Kl is . 
incremented by 1 (Kl is a count for the number of attri- 
bute' dimensions. ^imax_'* ' _ -r 

The current status, H(CS) is set to -M, H(M) is set to -3, 
and N2 is decreased by 2 . ... ^ ._ 

A new attribute dimension is created, and the poles^are 

stored in B$ ( J) and C$ ( J) . 
The program goes back to MODULE 4. 
* End of module. 



MOD ULE 1 3^: 



Lines 4045-416D i 



Parameter used -^1^2. .__ . _ ^>^„i^ 

If N2 is .<2 , the program will bypass the rest of the module 

and go back to MODULE 3. ' _ . _ 

"This module givei the user .the option of viewing a summary 

of progress to date by chainirig to LOS. . 
If no summary is required, the program passes on to the 

next itKDdule. • 
* End'df module. 



MODULE-a^-: 



Lines 4165-4495: 



Parameter used J . . - . _ _ . ■ 

This module allows the user to add another dimension ^o 
the list. J is incremented by 1 (Jmax = 20} , and the 
program goes back to MODULE 4. 

If the user does not wish to carry; out this process, the 
program passes dri to the next module. 

* End. of module. 



MODULE 



Lines 4500-4630 : 



Parameter used N2 . _ 

If N2 is <2, the program: bypasses the rest of the module 

and goes IsacR to MODULE 3. 
The module allows the user to elicit . another dimension; 

this process i^ carried out by goingback to MODULE 3. 
If the response is negative, the program will pass on 

to the .next module. 
* End of module.. , 



MODULE 14-; 



Lines 4640-4740: 



This module allows the user to investigate preferences 

between alternatives, i.e. , U values.. 
The program will chain to BRLT: 
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04: 



^^ObUiJ!: 14 (con tiriu o^) 



If tl\is process is riot required, the user will, have the 
option of saving the data f or . f uture_use . . Thi^ uses 
the st^rbutinei FIUE DATA (lines 5426-5500)"; 

* End of ;uodule . 



END OF MAUD 



Subroutine s in MAU & 



RANDOM TRIAD GENERATOR (lines' 5 375-5420) 

This subroutine generates three different numbers between 1 and Nl 
and stores those numbers in a G array. 

FILE DATA (lines 5426-5500) 

This subroutine files data in FLl , FL2 , Ft3,.and FL4 . (For more_ 
information on file storage , see ."Details of file storage," p. 52, 

DISPLAY ALTERNATIVES (lines 7680-7715) 

This subroutine displays choice alternatives between 1 and Nl. 
CHECK NU^!ERIC INPUT (lines 7900-7970) 

This subroutine checks that numeric input is within range. 
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APPENDIX B 



PROGRAM LISTING OF Mhm 



OOIO 
0015 
0020 
0024 
0 025 
0030 
0035 
004 0 
0045 
0050 
0051 
0052 
D053 
0054 
0 055 
0 056 
0 057 
CC5S 
UQ5? 
0D60 
0061 
0 0 62 
0063 
0061* 
0068 
0069 
0075 
0076 
0 077 
0078 
0079 

ongo 

• 0081 

oaa2 

0094 

0 0 85 
n037 

: : ^- 0 
j92 

0 0 93 





REM ♦♦^♦♦♦♦^^♦♦MAUri ♦♦♦^K»t»**f*f*t»t**H»«KM 
REM 

REh 

USE T*60^ S*3D , PS'3p 

USE C,J.N1^U2.K2.S1 

USE ?^f60 (20) ,E^60(20) ,C5i60(20) 

PlM_Zi64, Yi64,X*64,Q*64.E*64 
FORM PbSl,C 
FORM pqS65^C 

FORM ?.DS129,C ; 
FORM PDS193,C 
FORM PD5257,C 
FORM P0S321,C 
FORM PDS385,C 
FDGf"' P0C'!''.9,C 
FORM PDS5i3,C 
FORM PDS577,C 
FORM PDS641,C 
EQRM PPS7P5,C 
FOBM PDS769,C 
FORM P0S833,C 
FORM PDSP^C ._ 
FORM PD5895, Ci 
OPEN FILE FU5, 

ilf ^.«..>..,*.sr IS HAX kuRber of attributes 

REMISS AND 59 ARE HiN AND HAX NUMBER OF ALTERNATIN/ES — 
P9 = I 
REH 
Z^=' ? 
Y^= * 
E*=* _ 



• oo: 



, ALL 



?as9 -type YES 



NO* 



Press EXECUTE to proceed' 
IF u = l C-CTd 1+995 
If=^ C=- GOTO 53 0 0 
Tt_C=3..C-DT0 5215 



.:^03 
01QI+ 
03 05 
U106 
D1U7 
0 108 
0109 
0313 
03 14 
U115 
0 12-U 
0125 
3 30 
il 135 



? - : N'T 

I N p 'J 
IF 0*-= 
IF Q^- = 
PRINT 
PEXUT_ 
GOTO -I 
PRINT 
REM 

N1 = 0 
N'?^0 
h^T Z = 
M4iT X = 
hAT P- 



■::r you uani io use material already on file . 

'yES' goto 60 0 0 
■f^D' GOTO 109 

z> 

02 



U INITIAtlSE MU^ 
80 0 0 



( 0 ) 
( 0 ) 

C 0 ) 
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G7 



PHOO Q$='can be uhatevet y^fl. like, so long ai YOU knou, uhat you' 
nifOl REURITEFILE USING 54,FC5,Q* "T" .j . - . 

0LID2 REURITEFILE USING 55, FL5. ' Sean . You sh o u l d _ P ut^_ i n ^ 
OLfOS PFURITEFILE USING if Oi| , FL5 , P1> , ' uh i cH are avaiUble nou, 

0401* FORM P0S281,C16,X,C - - - ^h„„; • 

0405 Qi=las well as others_that you uant to think about, 
OMDS REORIIEFItE USING 56 , FL5 , (3$ _ ... __ .^r ^.^h' 

0407 REURITEFILE USING 58..FL5, ' K e ep the description of each 

0408 REURItEFlLE USING 4n9,FL5,S$ 

^ WMv^lsim S9.,^.^^orU iy.e Jus. one or luo .o.d.. 

0411 REURITEFILE USING 6l,FL5,E* 

0412 READFIUE USING 69,FL5,Q* 

0413 GDSaB_8l30O _ ^: . _ : ...^ ^^^^ „^ ^' S-i. 

0419 REURITEFILE USING 42 0 , FL5 . ' P I ea s e type in the n^me of -a ,oi> 

0420 FORH PDS129,C29.X,C30 _ ^ 

0425' REURITEFILE USI?JG i+3D,FL5, you uant to consider 
0430 FORM PD5i93,C3D 

U4'^t:i Nl=Ni + l_ . 

Qi|i|0 REURITEFILE USING i;45,rL5, name is 

04ii5 FDBh PDS3_21,C11,P0S333 

0450 RESriFILE IISING .455 , FL5 , A* < Nl ) 

D455 FDRM-PDS333,C30 

bit60 GOSUB 8000 

0465 IF N1=S8 GOTO 505 _ _ _^ _ 

0475 REURITEFILE USING i4(B0 , FL5 . ' N the next ,b4. 
OitBQ FORh PdSi29,C15,X,C30 - „„,,jHpr' 

01^85 REURITEFILE USING 490,FL5,'you uan . to consider 
0490 FORh PbSl93,C20 

0500 GOTO .435. .. % 
0505 GDSUB B.OOO 

ns^n IE NKS? GOTO 550 . ^ :i IL • * 

05^5 REDRITEFILE.USING. 53C?,FL5, 'You have cons.dpred the 

C530 FORH PC5S5^C25,P0S9.q _. . _ .. _,-p^ 

REURITEFILE DSING_540 , FL5 . ' ma x i mum number of , 
C^hO FOR.M PC:e?0,C17,X,C30 

.'.5-5 GOTO 675 - - - il . • 

•LSO REURITEFILE USING 555,FL5,'l3 there anothe; ,S^. 

ED><ri PCS12>=^ , C17 , C30 "-L "o- 

C?-a REURITEFILE USING. 565 LO 'you uan1 tt> consider-' 
'izlz FORtt-PC51 = ""..C20,PC'^._:.:- 
ZZz'J PEADFICE-wS:NG..5e^ ,FLC.. J'** 

"^i^. pr^^.^ POrC.:5,C30.. .... 

ci^O IF C.^^ .r = ■ GOTO 625 

N:=f^:^i - — — — : - . 

•i',0 REJRITtriLE USING 44^; , FL5 . M t s name is 
0£:0 KEADFIl-^ using 4r5,F*.5.fi1:(NI> 

C:32a GOTO. 5D5 _ _. 

Uc25 IF .Cr-='!:C.' GPTn..66r 
0-^30 KEUPITEFILE USIr^l3_ 365. FL5, Z'^' • 
0635 READFILE- USING 375.FL5,Qi> 
-0614 0 G□SUI^-8aOO: 
fj655 GOTO 590 

G6oU GOSUB BDDO - - - ----- - _ . ^ , 

0675 REURI'TEF ILL USING 6G 0 , FL5 , F^t . ' un d c-r considriat,on 

MFQRh P0Gl?V\Xld,CjB.X.C3n 
P=129 
GOSUB .7600 
u . P=P+12P 
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G8 



07^5 
07(^)0 
07A5 
0770 
0773 
0775 
0 78U 
028tj 
079Q 
0795 
ORdO 
0805 
0815 
0620 
0025 
0O3D 
0D3r- 
0R^ • 

0B4 5 
OG'JO 
0852 
U055 
0 86.0 
C06C. 
C88D 

aBb6 
OP07 
D'dVll 
0G95 

0 



ei = Pt3L+. . _ - .. . . . 

EEURITEf^ILE: USING 760 , FL5 
FDKh-P0SP.,.C33.PQ5Pl. . . ... 

RIALiFlLE-DSING 770,FL5,Q*t 
FORK PDSPl ,C30 

GDSUD 80DD 

IF Qi='YE5' GOTD 800 
IF Q>='ND' GOTO 1170 _ • 

REURITEFILE USING 365/FL5,23. 
REftDFILE USING 375,FL5,Q1i 

GOTD 775 - _ 

REM HHHH DSER-UANTS. TD. CHANGE SDhETHING_«Htt 
REURITEFILE USING 5i* * FtS, "E«o _ y o.u yan 1 io'_ 



Do you uant to change anything ?" 



' (2) Remove a ' ,5$ 
• (3) Add a ' VS'i 



REURITEFILE USING 820, FC5 
FDRh PbS321,X5,C22,X,C30 
REURITEFILE USING 830, FL5, 
EQ^m PDS385,X5,Cl3,X,C3b 
REURITEFILE US I NG . ,8^0 , FL5 , 
FORM pnQi>ii9, X5, CIO , X , C30 _ ._ _ 
Q1>=^ • P I eASt?-ty-po .j.n 1 2 . . or. 3 
REURITEFILE UGING_ eD0.,.FL5 , Q't 
FDRh PDS577,C27,P03^>o:i 

.READFILE USING 86;. , f'LS, PI- 
FDRh. .PDS6q5 , CI 
G05UI-* 8000 

KEh. . CHhNGE: a NAhE ^HH 
lF_Q•^s^M; ...GOTO 975 

P=P+128 - - - -- 

REURITEFILE U51UG 07S,FL^ 
^DRh^PD3H,C25,C3n 
p=P + 6i+ 
Pl=P+2n 

PEURITErlLE USING 705, FL^ 
FOfvfi. PQH = .C19, POGPl 
GOSUB. 7^ ''l 
P = p ^ 6 ^ - 

:^::^p^::: - --- - - - --- 

n Eiijf'- : 7 E - IUH: L'S IfJG- 975 , FL5 , ■ Nou narno 

FO?-. pc:?--,:;i2, PD5P1 - 

;rc-^FiL- J^:^JG 985,FL5,A1'CI> 



(1) Change the name of a * , S^' 



•Uha I 



the n un»b er ot the 



you u<irit to change?' 



= :H-£TE an ITEh 

' P _ 7 r z 



.: - p = p i J B - - - - - _ J _ _ _ _ _ .. ^ ... 

• r5 RilUPlTLri ^r: using 07"-, FL"5, 'Uhrjl is Ihe hdfnbcr of tho 

pj=-'P'-:7 /' - 

i*:i5 RLURJTEriLt: USiNG 1 n2{i., FL5 , ' ypu u.^nt to remove-' 

zlil FUKri..Po::=^..ci^, POGPl ' . ■ 

I ri:'r. GtJbUF< '7>''c.n . .. _ - ■ 

llj7o IF-I=f-'I GCTQ. 1 090 
i 075 P*DR J^l TO Nl -1 
: p '■' 0 f*i T ( J ) - (M ^ ' 1 J 

3 i;^ S fJTXT wi 

1 ov,' y:-^tii"i 



1 095 GOTO 660 - . 

iiOD REM liMHMHMtt ADD AN ITEM I^HHttHHH 

1105 IF Qi;^'3' GOTO 755 

1106 IF N1=S9 GDTD 525 

1107 C3DSLIB 7.^80 

1108 P=P+120 

1 11J3 Ni=Nl + l.. . ... 

II15 IE..N1 >55l_GDTD_525 ._. ... ._ 

1120 REaRITEFIl S -USING 1 1 25 , Ft:5 , ' P I ea se typ^ the rd.7)e o\ ',51. 
1123 FORM PDSP,C28,C30 
il27 P=P+6^ 

1130 REURITEFILE USING 1 1 35 , FL5 , ' j ob you >.int To . 
1135 FDRh PbSP,C 
imo N*=CHR(N1) 
ll'+2 P = .P + 6^ 

11^3 Pa = PtlD 

3m5 REURTTEFItE USING 1150 . EtS, ' < ' , N1. . ' ) * 
1150 FDRH PDSP. CI , X, CI , X. CI , PDSPl 
j U'5 REAL'FlLC UBIK'O 1 160 . rL5 , TiT < Ni ) 
1160 FORM PDSPl . C3U 
1165 C5bTb 660 

13 70 REM ^**^*^INTRDDUC£ METHOn OF rrIFFERENCES»*^MW*tv*f 
. 1171 J=0 ... 

1172 GQSUe 8000 . . . _ _ . . 

1373 PRINI 'You e nou?_going t o _ b e . a sk _e d about _d i f f er en c er> ' 
1171+ PRINT 'B^ + ueeri Try to think about d i f f or n Ce s ■ 

1175 PRINT 'uhich are impor+*aht to y b u _ i ri . mal< i h g your . dec i s i oh ; * 

1176 PRINT 'For instance, some people feel that certain ' :f'l 

1177 PRINT 'arp INTERESTING uh i I e other ;;P$;' are EiQRlNG,' 

1 1 73 PRINT ' an d s ome ' ; Pi ; ' __ ^ T ^ . .'.^i . ^ ^ .'_ 

117? PRINT 'This i s jtftst on p e xarnp j e a n d may n q t ^, b e r e ( p u a n t t o ' 
IISO PRINT 'you, Th ere arc no. r] ght or._urgn.g._ansuer5. .Even jf 
IIcl PRINT '. yoQ are_not sure.thatycu. a re. correct about an. aspect' 
1132 PRINT 'cf Z ';S-$;*, just uorI< with uhat yua imagine it" 
1 : Z3 PRINT 'to t e like.' 
i:?^ PRINT 
: 1?5 PRINT 

1156 REURITEFIL^; USING 64.FL5.E$ 
lirr REAr.FTLZ JHIrJG 69,FL5,Q$ 
l:.?^ J = Jrl 

GD3U? . = 00^! . _ 

:2:3 i^..ji£i__^r~o .125.0 ... . . '. 

Ilia SZ'-^?.Z7E^ZZZ aSING-1215, FCS . ' At tr i but e dimeri^iion storage " 

lZ:Z -Cr- -r^ll? . C2R. POSIC:" . . ... 

::Z. f?Et--;TE~r^E using 1225.FL5. 'space full. " 
112Z rOP.n PCtir7.C3d 
IIj' GdSU? S^J'J 
l2^•f' GOTO Hc23 

3 25U Cj*Ji="C9n yo>^ specify a uay, in uhich one of these' 
l2t;S f^EURITEFlLE US I NG • 53 . FL5 . 
I27n GDSU? 5375 

1275 REM._- 

.t2D0 P='l93 
1 ?P5 FDR 1=1 TO 3 
3 2?n NC-. = CHR(] ) 
1295 P=P+64 

1 j;(!h E^n< I) ' 

13U5 HFURnEFJLE U31NG 1 3 1 0 , F L5 , ' ( ' , Nl> . ' ) ' , ( E ) 
]310 FORM POSP, CI . X , C2 , X , CI . X, C30 
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'TQ 



1315 
1320 
3 3:'5 
1330 
1335 
1337 
13»fa 
1345 
135 0 
1 355 
1360 

13 65 
1370 
1375 
138D 
1385 
1390 
1395 

14 do 

14-05 
1410 
1415 
3 420 
1425 
1430 
1435 
144 0 
3 445 
1450 
1452 
1455 
1457 
' 3 460 

1 ji 



Xi< l)=Af.(E) 

NEXT I - 

Cji=*is differeril f i- o m_i U e o t h e r 
REURITEFILE USING 59,FL5..Q1' 
Q$=:'to you nou)? Please 
KEMRITEFILE USING i34D,ru5,Q3' 
EORW P0S577,C55, PDS633 
RESriFIDE USING 135b,FL5,Q^' 

FDRM-PD5633,C . . . . _ . _ 

REOR I TEF IDE-USING .64 , FL5, Y$ 
IF G|*?i'ND- GOTO 1385 
FDR 1^1 TO 16 
PRINT 
NEXT I 
GOTO 1250 

iF..Q*=_' yes; 

REUBITEFILE 
REORITEFltE 
FORM PDS513 
GpTD 1325 
REURITEFILE 
FORM PDS64i 
REUKITEFILE 
EDRM PDS673,C 
REURITEF_IUE USING. 1435 
FORM POS7.05.C16, P.DS721 



■tuo (in d uay ihal maHer 
ansuer YE5 or NO ' 



GOtO I4i0 
US I N G 365 , F L5 , Z i- 



USING 
, C63 



1400 ,FL5, Y« 



USING-1415, 
C32, P0S673 
USING 1425 



fl: 



'Uhat is Ihe 



Ft umber hex-t io i\ 



Ft:5, SI- 



, FL5,S$, "that differs ?' 



'PVease typv 



READFILE USING 1445,FL5,CS 
FORM PL)S721 , C 
Qf. = STR( C$ ,1,1) 
IF Q^^- * 1 * GOTO 1465 
IF..Q*>*.3' GOTO 1465 
ti=NdM^ Q^ ) 

GOTO_1490 _. _. . 

REWRITEt^lbE USING 1470, FL5 
FORM-PC^ V.?.C2S,PPS7?7 . 
PEADFILE-USItiG 1480,FL5,C1. 
FORM P0i777,C 
GOTO i45D 
GDSUB E'-' -'O 

Qj='Yc>u i-i = "e said th^it'- - 

?Eli-?,lJErlLS. USING i51D,rL5,Qi.);^'<I'> 
ko^rt PQS^Z Cl8 , X, C 

eh:j-°^te- using i52b,FLC., 



'different from 



3 t>6ri 

1565 
1570 
1575 
I5''^n 

3 'o /ii 
15*r5 



1575 

1565 - - - 

USING ir<50.Et:5. 
, C3d , C4 , PD3237 



X'J' < 1 )', 'and' 



FOR 1 = 1 

iF 1=1' o:"-:. 

IF C=l 00^0 

FOPn POSl-7 

:C=1.. 

GOTO . 1575 
RCUT'TT^rJi^E 
FDKW P0S23V 

NEXT 1 

Q-;.= • f h h M -fTiiMie titan i hv p 

F'rui?lTEr iL-'r ufn^n 5<'.;FLS-trt 

REURlTCriLC U: TNG 57 . ft:" . t^! 



US] NO 
, G30 



i57n,rL5,X'i'<i> 



r.ti -t i m<- , p t oa^t' dtsr.> 
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lodu ^^URitEFiLE USING 1605 , FL5 , ' F I t describe *,X$(D) 

1605 FOKh POSM-^? , Ci5 , C3d , - 

1610 REURITEKILL USING 1 6 1 5 , FL5 , Xi ( D ) , * i s 

1615 FORM PCS513/C30,X,C5jPOS577 

1620 READFILE UMN^= . 60 , FL5., BM' < J ) _ 

1630 REURlTEFtc;'' "JNG 61,FL5,"0n Ihe olher hand,* 

1640 C=0 _ . _ 

1645 FDR ; -1. . V. 

i6"jO IF I=rti GU : , 1690 

i655 iF'r-J GOIC. 1680 

1660 REU - . '-il USING 1665 , FLS , X$ ( I > . * and ' 

16d:5 FORM POS > j5, C3d , C4 , P0S739 

167 0 C=l - 

1675 GOTO 1690 ■ .. - 

I68Q REURITEEILE USING. 16B5 , h L5 . X5. < I ) , ' ar e 

16B5 FORM P0S739,C::5,C5 

169U. NEXT I 

1695 REAliriLE USING 63,FL5.Ct(J) . _ 

170:=; RFUPtTFFtj.r ;i'^tNG 171 D . . ' . ' ' ■ c vnu rc-tcnl^St/ f-.Gpp> i 1 ' 

:710 FORM P0n833, C3d , PdSB63 

l7iS REUKITEFILE USING 1 7.7 C , I Li, , ' 1h ; s dei^c ' i p i I on ?' 

J7nU FUPM. POSy63.CJ0. PqSBe3. ... ; 

172'o EESIiFlCE-DSiyG.. 1730,FL5,q* 

1730 FORM POSB83,C10 

1735 IF qt.= -NP' GOTO 1760 

3740 IF Q1i="Yt:S* GOTO 1825 

17M>'. REUlRTTilFILE USING 365, FL5,2t. 

I7';.n READFILE USING 37;j,FL5,Q* 

I7r>5 GOTO 173:- 

3 76 0 GOSUtt BOO-:.' 

1775 REURITEFILE U5INC5 178b,FL5,'Do you uan-t "to descri-be again' 

17011 EDRM_Pn31.9.3,C30,..POG223 . ._ _ 

17^5 REUPTTEFICE U5 1 NG.. 1 79 0 , FL5 , ' h 0 , Xli < D ) 

i-^'-'-'o FOHM P0£ir::,C3,x,c — — . . . .. . 

^--5 REURITE- USING 1 80 0 , FL^: . ' d 1 i f" e rs from th? other "tuo ?' 

:e ^0 FORM PO5157,C30,POS2B7 

:-r''t' R£ADFIL£ JSING IBIO.FLS, 

: M J FORM =C5r rT , C 

:£i; IF . GOTO . 1490 

^-22 IF CS= i-iZ-' GOTO 1197 

.-5 REM -A^Pf.UIITH DESCRIPTION 

: PEn =:~:cit j-scaced scores of itehs on current dim 

^.t'z L^5= w.^. "cu rioiiJ h^iOe a scale goihq f orn' 

^EwP:tE":_E Using 5i,FL5,Qt' 

. . -. : P=c.5 

: : ~ Gos'jft 55 r ■: 

i~zZi reuritef :;_E Using 1957 , fl5 i^s ihi .. scjif d.K'^' 

1957 FDRr PC37 1.7 , C 1 7 , .P_0.S787_ 

jyti-D E^EsriFICE-'JSlNG. 1959,FL5,0* 

iv:39 FORb POS737,C10_ 

1960 IF Q'5="YES* GOTO 1970 

1^61 IF D$='NCi' GC7D 1760 - - _ 

1967, REUklTEFILE USINC 1964. FL5, 2^. 

196'* FORM pdSP33, C25, PdSe59 

l?o5 READFILE USING 1966,FL5,0i 

3966 FOnri Pn:^859,C!0 

1967 GUIU ] 9.6U. 

.1970 GOSLIP 80 00 
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l^nr^ Q1>='It shoutd.be possible to yiOe eoch 
197H REURITEFILE-DSING 1975 , , S$ 

1975 F0RM_P0S1,C35.C29 . . ^ according to M'^ position' 
19G0 Q^='a rating from 1 _ t Q 9. a cc di a i n y 
1985 REURITEFILE USING 52,Fn5,Q^ 
199QQ^=^onthescate' __. 
1995 EEURITEFILE USING 53,FL-5.Q* 

20DD P=193 

2005 GDSUB 8860 
2065 P=211 
2080 FOR TO Nl 

2085 P-P-|;6'4 

^090 Pl = P + '+^ - - 

':>100 REURITEFILE USING 2I05,FL5,Y* 

SlT^F^truSING 213=,r.3.-Vo..- va.in. of .<^*a>, 

n FnRH_FD£P-Cl'+,X,C2»+,C5,PDSPI 

i]^D Ri^it.FICE-USTNG 2145 , FL5 , I $ 

21*^5 FDRM P05Pt,C2. 

?150 Q^=^5TF<I^,l*Ii 

':^i5'' Qi^:'l' GOTO 2165 

2155 Ir- C*- -9' GOTO 2:^5 

2157 Z'.l , J>=^NUK<G)'t ) 

216a Go:n 22'j& 

oj7^ D'^."rJea_?e type a number Uet'^erri \ and 9 

2175 REU-TTlTFIuc . USING 2180,FL5,U'J 

2aB0 FORh .MjSP2,C56 

219b GOTO 11 GO 

2200 N^XT^i 

2210 K = P-*'6^• 

^ ^^URiTeFILE USINB 2.-:..K,..= ,-.. — -.in.s DK ^ 

F0RH-BCEP...C23., POSPl _ _ 

--^B READFICE-USING 2235 , FL5 , Qt. 

"2-5 FORM PC5?I,C1.0 

--•I'i IF Q<^= V£5" -GOTO. .2530 
■---5 TF Q$^ :-D' G0I0--22o'v. .. . ._ ^ 
"-O-REURI-TZFI^E; .USING_2252,FL5,2^ 

FORM POSdo:?,C26,POS39-0. ... 

PEt^DFILE 'J3xNG 2257 , FCS , Q1> 
-L?- ^GKrt POE^.^n .C3 
12^0 GCT: 21'^^ . _ . . 

RE'r --TINGS NOT OK 

Zl~ G0 = -'I* 3 • ^ 
2Z-2 Pl^O 

22~5 GOTO 8270 - 
-^^■20 H( J > = -i 7 "'' 
2525 CSOTCI IIB:- 



REM ;*>^>-"ELlCn iriEfit POINT 



2535 GDSUB.&njO _ _ ^ ^ belou, uh ^ i • P o 5 i t i on ' 

':>5i+D Q5>=* Th 1 nl^ I ng only about_the ^cait oei , 

^5U5 REURITEriLE USING 51 , FI-5 , riT. . _^ . _. 

-.50 Q^-*OQ ihe ^.cal. t.ou(d you liKr mn^i 0. .all fo. 

2555 REORITEEILE USING 52,rL5.at . _^ 

---.^,n prupnFFiuE uniNG.25d.5.F' , cn iri[-,r.^n ,0^ 

2565 FDki-i POS129.C9.CU0 

2575 P=193 

2t'5 0 GOSUR r.S6(i 



66 



REUiatrFlL.E USI^!G 259a, FL5, 'Your best possible value 
FORM P0S^d3,C29, P0S433 - 
READFILE USING 2770,FL5,I^ 
FORM P0S^33,C5 *^ 

Q*=STRCI*,.1,1) 

IE Q$<'1* GPTP 2860 
IF Q't*.- ' 9'. . GOTO 2860 

p( j)=NDMXQi ) - - ^ - . . . 

REQRITEFILE USING -281 Q , FL5 , * I s this atright? 
FORH ^055*^5 C17,P0S612_ ... 
REAtiFlLE USING 2B2D,FL5,Qt 
FORh PgS612,Cid 
G0SUB_8bdd 

IF Q$=*YES* C30T0 3d8d 

IE q$=;NO* GnTO.2920 

REURIIEEILE USING 2252, FL5, 2^ 
REDRITEFILE USING 2850,FL5,Y* 
FORH P0S595,C46 
GOTO 2505 

REM • 
REURITEFILE USING 287d,rL5,Y$ 

FORM .POS^03iC^6 _ . 

Q^-lPi^asp type a number between 1 and 9 
REDRITEFILE USING 2890,FL5,Qi 
FORM E»0S531,C36 

GOTO- 2585 

REH *>^**RATINGS NOT o . K , 
GOSUB 80 dd 
Pl = l 

GOTO 8270 

REM J TO I SCALE HAPPING 

GDSUB 3000 

Dl=<3-i<^JX - t 

IF B< J)^:5.D1 GOTO 31 15 
ril = B^ J) 
FUR 1=1 to Ni 

ri2=z\i_L-J>-E<iJ^ 
xJ:i,^;=^Di-A&s(ri2) ' 

blE'^T r 

-£>^ ******* tt»*»**»*»**#»>^^>t**^********t***;^**^********^*^ - 

pr*. — ^lUCST SCALE SO THAT (UbRST) = d ANlJ <BEST)-I • 

w- 1 5 'J — ~ ■-' 

?.155 ?Z'r* TO Ni - -- 

3160 IF >'':.Jj>Xi GOTO 33 7U 

317D IF_)«: ' I ! JXX2 GOTO 3180 

3175 X2=XCI. J) 

3180 NEXT. I... 

31B5 X2=X2-X1 

319U IF X2>;5 GOTO 3395 

3:95 REM 

3-^00 REM -' ALMOST NO RANGE OU. I tCALE r— 

3205 HEURITEFILE USING 321 0 , FL5 , ' Th er e seems to be very 
S'^IO FORM P0S65, r:3b . P0S95 . - 

3215 JRITFC.riLE. UGINC 3220 , FL5 . ' v a r i a t i oh in your Picle 

3220 FOPM . POS95.,C30 _ .. ^. nt 

3:.:25 RI^URITEFILE USING 3230, FL5 , ' or der i n 9 ot ,1^ 



2585 
259 0 
27A5 
2770 
2775 
2795 
2R00 
280 2 
2805 
28ld 
2815 
2820 
2825 
283fl 
2035 
2840 
28t+S 
2B5d 
2Bu5 
2860 
2865 
287a 
2875 
. 28B5 
2890 
2895 
2921) 
2925 
2930 
2933 
3075 
3080 
3085 
31 dd 
3105 
3110 
3 1 15 
312.0 
ZI25 
3130 
313"5 
31^0 



little 
r e 1 1 c p ' 
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323D 
3235 
321*0 
32U^ 
3250 
325S 
3260 
32^5 
3270 
3275 
32Bfl 
3285 
329D 
3295 
330 0 
3305 
3310 
3315 
3317 
332& 
3325 
333 0 
3335 
331+d 
3345 
3350 
3355 
3360 
3365 
337U 
3375 
3:395 
3390 
3595 
~^0C 

- 7T •^tr 
I'^'^ 3 fi 

--UP 



FDRh P0S129.C12,X,C3D,P0S172 _ --- 

KEURITEFILE: Using 3240,FL5,*on this scale 

REURITEEILe'uSING ^^''^ choice of 

SitEfJce'd^?^^^ Chansins voar ratings on 

FdRH P05389,C29,H0S^.18 _ 

REURltEFlLE USING 327 0 , FL5 , * t h 1 s scale 

SiPilI'Ip 328C,FC5-2> Chan. ins the Ideal .al.. 

BEURITEFILi'uSING 329D,FL5,'3) Changing nothing* 
F0RM-EQS^17.C3q_ 



•please type your choice 
* 1 »2 or 3 : * 



3^C'^^ 
■XLj •> 0 
34?u 
3500 
3505 
3t,l P 
3515 
352 D 
Zt,?.'' 



r U» rv H - 4- WW * - _ . _ _ . 

REURlTEEItE USING 3300 , FL^ 
FORM PDS6m,C27.P0B668 _ 
REURltEFILE USING _33lO , FLS 
FbRrt_PdS669,C17,H0B6a5__ __ 
READFILE USING 3320, FC5, I* 
GOBUB 8000 
EGKti_FG36S5,C5 
IE I*=-i' GOTO 1972 
IF I«=*2' GOTO 2540 
IF I«==A3: GOTD 3^55 _ 
REURITEFICE USING 3345,FL5,Y* 
FdRH P0S641,C63 

REURITEFILE USING 3365,FL5,'0K 

SlTEriLl'ilNG_6.,FLS,/P,-ess EXFTtUlt: io Proceed' 

REftDFICE USING 306b,FL5/Oi 

H<J)=-99_ 

P°^^!cahPUTE VARIANCE IN PREFERENCE ORDERINGS^*.^ 

FOP 1=1 td Ni 

xc, J'^ = ^XiI, J)-xi)/x2 

Y< j;^r.J)-^X(I, J) 
yiJ.>=V^ J)+XCI, J)T2 

NEXT :.. . . .. ... 

c; J -.i*V( J)-Y( J)T2)/N1 

' r - ~ uTD 4 045 - 

-l^^ UCUI CHECKING 

r i£ r=; TO J-1 

Fv.i,J^=-^- --- 

; T F H- h ; : ; 5 uG'^D 3740 

F G P I = 1 T 0 N 1 - - - - ; 
P1 = R1 + K( i . J>*^X( I ,M). 
NEXT I_ _ 

Rl^CNl^Ri-YCJ^^'YCHn /Nl 
JF. P(h,.J) ' .Eil> GOTO 374(1 

KrM Z^i;>"'cMECru"rTH*USEI> AI^UUl RA1 INGS ^i^^^ 
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3535 REURITEFILE USING 35i+d , FL5 , ' Yb ur preferences for the 

351+0 FDRM-EO565.C30.PPS95_ _ 

351+5 REORITEFltE.USING 3550,FL5,P$ 

3555 ^^UlllTEFILE^^ING-^ c on s i cie v a i i 0 n In terrhs* 

m W^MlZl'^i^^^^^rof .heir ra.in.s on .he s^ale' 

3575 REURIIEFILE USING 3580, FL5, ranging fi om ,B*(M) 

3580 FDRH_PDSl93,C:ri+,C3d.PDS237 

3585 REU?!ITEEILE USING 3570 , FL5 t 0 ,C^(M) 

3590 FORM P0S237 , C5 , C30 : _ . 

3595 REURITEFItE USING. 3600 , FL5 se em very much the same as 

Itll SlTEFILl'uilNG 3.20,FL=,P*,'i. te,.s of .hei,- ,-a.:.„s. 

36-^0 FORM PDS321,C30,Cod V. , " 

36^5 REURITEFILE USING. 3630^ FL5 on the scale r^natn<3 f > om 

3630 FORM PDS3S5,E28..PD5'+.13 _. . 

3635 REPRITEFICE USING 36i+0 , FL5 , IrP ( J > 

361+0 FdRH PDJ^413,C30 • 

361+5 REURITEFILE USING -3650 , FL5 , to ,C4>(J) 

SiT^IlI'S™^^ this ...n that those I.0 

^ ^.^'mi^^^^f-^rsc.^e. .e.n sl.i.ar thin..' 

3670 FDRM-PDS5i+3,C30... . 

3675 REi^JRITEFItE USING. 3680 , FL5 t 0 you r» 
3680 FORri PDS577.Ca,P0S5Q6. . 
3685 REAI.iFiLE USING -3c90 , FL5 , Q$ 

3690 FORM PDS586,C10- 

3700 IF Qi='YES* GOTO 3755 

3705 IF 01i='ND'_GDTD 3730 

-^710 PSU5II-IFILE USING 365,FL5,Z-t 

3715 R£OR:TEt:iLE USING 372d,FL5,Y^ 

3720 FDRrt paS577,C63 

7.725 GOTO 3675 - - ^ 

m W^^(l SI^N^ T^^P^SS EXECUTE xa PROCEEB^ 
2732 f^EADFILE USING 69,FLd.O* 
3733 gBsUB 5 0>"^"0" 
3-35 FOP,^ =r:57n5.C2 



* * ^ # >t * > H »* ^ 



3755 RE-^ CDN51 PUCTIVIST SOLUTION ^^^^ 

3757 5 'J 0 H 

3760 H(J)=-^ 
3765 N2-N2'l 

377D h:.l = J"l . 

3775 IF.Kl.Sl.GOU) 3800 

3795 GOTO 1210 

38 0(i Hi-M).---J 

380^; N2-K2-I ■ 

3910 Mi=0 

3f?Jl!^ JI^O 

3B2U 

3S25 FOR 1=1 to Nl 
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3830 Ml=Ml+Zd,H) ) 

3835 J1=J1+Z(I. J) _ . 

38H0 Sn=S2+Z( I , J)i*Z( I , M) 
3845 NEXT I_- - 

3850 Rl -Nli*52-dI*^Ml ' _ - 

3855 Qt'S'D.K. Please tv^e in. a uord (or nhrase o. not more thari 

3860 R[:jlatEFILE USING 51 > FC5 , ._ 

3B65 Q^»=;^three uords) uh i ch fias the same me.lning as both 

3B70 REURITEFILE USING . 52 , FL5 , 

39nD REURITE'~ILE USING 3905 , FL5 , < M 5 , " an d " 

3905 FDRM_ P0Sl29,C3b , CM' ' ' 

3910 IE Rl<La_GOTO .3930 

3915 REORITEFICE USING 3920 ; FL5 , ( J ) 
3920 FORM PO5l63,C30 

1^922 GOTO 3935 - 

3930 REURITEFILE USING 3920 , ELS , ( J ) - - - 

'^935 REURITEFILE USING 3940 , FL5 , ' Yb ur heu udrds(s) :' 
3940 FORM P0S2S7,C2d, PdS321 
3245 RnAr^riLE: using 3950 ,FL5, IS 

3950 FORM PO5321.C60 __ _ _ 

3955 Q^fc=:NaQ_-piea5e. type in_a word (or phrase of not more than 

3V6D REURITEFILE USING 59;FL5;Q$ _ 

3965 Q$='three ubrdt) uhich has the same meaning as both" 
3970 REURITEFILE U'JlfvG 60 , FL5 , Q$- - . - 
3975 REURITEFILE USI^G 3980 , FL5 , G$ ( M ) 
3980 FORM PDS64i»C3d 
3985 IF R1<:0 GOTO 4005 

39.90 KEURITEPILE USI Ni5 3995 , FL5 , ' an d " . Cf. ( J ) 
39V5 FORK PaS672 , C3 , 030 

4000 GDTO_4010 . .. . __ 

4U05 REURIIEFILE USING 39?5 . FL5 , " a n d , ( J ) 

4D1D REURITEFILE DSING_4ai 5 , FL5 , * Yo ur new uord(s) :' 
u:dl5 FDRn PD57D5 , C20 /P0S769 
^Q2d J=K1_ 

^025 ^^E^l^^l'^E USING 4030 . FL5 , C*3i ( J ) 
■*'Z0 FOPr! . FC5769»C60 
- :-35. E<5 C J> = :^^ 

■ ^O^a GDTG 1 cZO ^ 

--^.3 p=r^ NO_SIMILAR- MEANING. .E<£TUE_^N. 

--^=-; 2 SCALES-OF BIMILAG RATINGS..-- — --~ _ 

-••^57 PE-^ *-^--tEE if person UANTS A SDMMAR Y*t^i*i**»»*^i**^ 

- . I:* :^ •:: z :-:tTO 1195 

i; IF :^3Td 4d65 ; 

vij Gii="U.. .::d yo-u like_to be reminded of vhe information you' 
■ 75 Pn-=^ITE-It-E USING 52, FL5.Q$ 
uutiD Qi:»= :b£r^i^-Piit ...i.D. so.. f ar?.' . .. .. 
4UH5 PEGPIir^lLE a5ING--4D9D,FL5.01. 
4d7() FOkr) P0G129» C19.. POSI50_ .._ 
•4110 REAIiFlL£ U3IHG M115,FL5.Qt 
43 35 FORh PdS15D.C30 
4325 IF Qi^;Y£5' GOTO 43 40 
4127 GPSU^.SO.OU 
4135 GOTO . 4.99.0. 
t.3 4 0 IF. Q'^P^.'.f^P.' GOTO 4' 45 
in Ml GOSar<. QOi'O 

4142 GOTO 4165 _ 

4:l:5 RLURITFTILE USING 3r.5;rL5,2^> 
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i+15d REURITEFILE USING m55,FLti,Y* 
1+155 FORK PDS129,CS3 

HI 60 GOTO 4 08D - -- 

1+165 REM M#»#*riIRECT ENTRY OF Dli^ENSION POLES***^*^*'*^*^*^^*^** 

i|170 Q$='Can you ihink of, any bihef-uay ihai ihe' 

1+175 'REURITEFILE USING 4180 , FL5 , , P3i ^ 

i+lBD FORM PQS1,C3?_,X..C:^5 _ _ . _^ _^ 

meS REURlieFILE USlNGm90.rL5. 'differ from each other ? 

1+190 FORM -PO'S65^C2H..PDS90 . . ... 

U230 READFILE USING H235,FL5,Q^> 

H?35 FORM POS90/C10 

i+'^'i+O REURITEFILE using 6^.FL5,Y1» 

1+2H5 IF tP*=*Y^5' Goto 4275 

4250 IF Qi= • NO ' .GOTO M-50D 

4255 REUIRITEFILE USING 365,FL5,Z3i 

H260 REURITEFILE USING 52,rL5,Y^' 

4270 GOTO 41B5 

4275 J=J+1- - 

4320 IF J>S1 BDTG 1210.. 

1+325 qi='In noi more th^iri In te _ uor dii each iinie, pitd'^e ues<-.M. 

4330 REURITEFILE USING 54.FL5.a$ . - 

4335 Q1'='hpiJ some of ihpm differ from thp others. 

4340 Ri:URITEFILE USING 55,FL5,Pt' 

4355 REURITEFILE USING- 43^,0 , FL5 Some are : 

4360 tORM_ PD5385,C10 , Pq5397 

4365 READFILE- USIN.Ci. 4370 ,FL5, ri*< J) 

437(3 FORM P0S392,C52 _. . _ , 

4395 REURITEFILE DSlNG-440n. , FL5 , ' Uh er as others are . 

4400 FORM P0S449,C19,P0S469_ 

4405 REAItFILE USING 44 1 0 , FL5 , < J ) 

4410 FORM Pb^469,CMU __ ^ +k ■ 

4415 REURITEFILE USING 4420 , F LS , ' Sr i> you rcoson^ably h^ppy u-itn 

^42n EDKM PDS577,C3b,P056b7 

U~iJ^2t REURITE^EILE USING.: 4430 , FL5 fh i s description : 
Kh3^ FDRM-?:iS5-07, C20..P(DJ?627_ ... ; 
UU35 REHliFILE OSIWG 4440 , FL5 , Ql- 

^4-40 FORM P05627,C ^ 

-c50 IF Of=*YES' GCTO MM55 

-'-;51 GbSU^- 30C0 

-.'^^■2 GCTO 1H15 

-•-^55 IF 0£=i'!-0' CdTCi Hi+QO 

^-75 GO^O_^I = e:. .._ . . 

-z:^-Z':Z~Zt.E USING 365,FL5,21> 
^^^5 r,~:-:^I-:LE USING 59,FL5.Y-i ^ 



:,r05 Kin iiO AIitHTlDN^L WhY OF RATING SIM. AND TilFF . 

',M5 GOSU^- 5.-6b 

L^-.-^l.' IF fC' - : coin 1195 , 

tt55a PEUMTETF ILF USING 4535 . F L5 . ' ti n you thini; you .ave no-... 

1.535 FDi<h_FS365..C26%R0S?l... _ .. ^ 

4540 REUr:nt-:r-:iCE-U5TNG 45115. FL5. 'wurkod throtinh enough oi irn 

l;5U5 form PDH:91 . C30 _ . . - .._ 

45r.n P^Um j TFrn.r Ur>lNG 45fjtii.f U5, 'ma in uaysi of der^cr i b ! ng 

4551:.' FbKn ^ OS 1 19 . Cl^M , PD551 53 _ _ . _ _ _ ;. . , 

k;^60 RrurUTf-riLt: USiNH 'n5/>5 . r LL- . ' i m l l ar l t l es ^lU. diffcrpnr.s 

M ^, L J F u r. I-. Pt' !" ► 1 G , C: S 0 - 

4570 REURIiLriLr: u:;!^^ 4:,75 , rLS» 't'PtucM'r^ the-.P^', L-tiich you 
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78 



5575 
M50d 

4610 
iV6\l 
4612 
4615 
4620 
4625 

4635 
'46411 
'4645 
46^0 
4 65'J 
466(1 
4 665 
4670 



ii-ik are importan-t 



FQR«-PD5193,Cl2,C3d,C ^ . 
REORITEPItE USING 4535, FL5, 
FdRH PDS257.C23,.POS2.8.0^ 
REAtiFlLC USIUG 4595,FL5,Qt. 
FORH PCSC280,C - 
l^- Q5'=*YE:S' goto 4635 
IF Qli!*^ ' NO ' GOTO 4615 
GO5UI:«_80p0 
GDTa-119^ 
REORITE-^XLE 
Rt JRlTEriCE: 
FORM PDS257, 
GOTO '1580 



USING 
USING 
,C63 



365,FL5iZf 
4625,FL5, Y* 



REURITEFILF 
FORM P0S3f.5 

reurit.efile: 

F0RM-EDS412 
REUJRlTEFltE 
FORM HCS44^ 
R£URltEFILE 
4675 FORM P0S499 
4680 R'EURITEFILE 
4685 
4690 
469J 
47 0 0 
4705 
471 5 
4720 
i;725 
4 730 
4235 
U74£l 
U.745 
i^?46 
-■-74 7 



, FL5, 



USING 4645 
C27, PDS412 - - 
USING 4655, FCe 
C30 

USING 4665,FL5, P$ 
C30.':2q ; PCL)M99 
USING 4675, ?L5, 's 

C - -"- 

USING-46e5,'-L5 

FORM PbS513,L28,P05541 
fiEUUnErlLE USING, 4695, Ftj 
FOriM PD5541 ,C2d , P0SS61 • 
RSfiDFXtE, USING 47d5,rL5,qi 
FORM P05561 ,C .... 
IF Q*=' YES' -GOTO. 4855 

tji^'NO' -GOTO . 4745. . . _ ._ 
RFURITEFiLE USING 365.FL5^Zit. 
REtlRITEFiLE USING 4735 , FLt; , Y 4- 
FORM P0S513,C63 



y 0 u V 



r prcfvr.nces among 



1he 



basis of -the" 



i i I a r i 1 i e 5 ' 



•and differences yoa-.^ave 
'dfscribr'd so far ?' 



GOTO. LicBO 



RErt. 



^ » ^ )* H t* +r ^ +t V. t- *f if V w t ♦* tt H 



-r":d!:. 



K£Ullj:TZriLE 
'^MZ^ - - 
■GGSUr - SO 0 0 



USING 61,FL5, *0:K 



USING .4755, 
C3D._P0B671 
E USING. 4765 
1 , Ci5^P0&6S6. 
ilNC 4775, FU' 
6,C 

■ GOTO UJOO 



FL^ 



thai Is all for n')Cj. 



a cton-t 1 0 save a I 



'lio 

' i n f 0 V tr. B -t ion 



-rV95 

'i ci 3 n 
4Bi 5 

4025 

48N5 

4ti5l:' 
4156 U 



Goro — 

J fr Q - 0 ■ G 0 1 13 i.l. D vS 0 . 

ptURITEFJLE mS\K^ 365^ FLf.. 7«i> 
RCU. T TEFi LE U^JiNG 4U]5,FL5.Y 
E'D!;;i P056U 1 . C63 

Gv«lD.'t75p . _ . . __ 

Flilr^r ■.1!A1A NOU F3LEIJ 



IN FlCC 
r INlSKiEU i 



.NiiMr;r.R' 



ST DP 



; >. M K 1. H i« -if « H K <^ K H ♦< V ♦* :< 



Upf IPh tUL USILK: .oM ,rL.5.,l:.^ 
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i*Q6t; GDridB! 8onfl_._ 

UHDO IF K2=-i) -GOTO -U970 

4Qgti REORITEFILE USING -4890 , FL5 Ho you want fo complete your/ 

4B9d FpRh PDS6S^C3D, P0S95 

4G95 REURil EFILE USING 490 0 , FLS , ' p r e v i c u^i ( j n c bmp t e 1 1? ) ' 

4<?bd rORh PCj512?,C22,PdS151 

M9lJti REURITEFILE USI NG. 491 0 , FL5 , ' I n v e s 1 1 ga t i on s of preferenco*: 

4910 FORM POS151,C30 

4915 REUraiEFILE USIim. 4920 , FL5 , ' < ra th er than start again) ?' 

492fl FORH_ PDSt93.C29.,P0S222. 

492ri RESnriCE-D5:NG_4930 .FtS.Qi 

4930 FQRh POS222,C30 

4940 Ir C3*='YES' GOTO 49Q0 

4945 IF Qt.=;Nd- GOTO 497D 

4950 REURITEFILE USIf^G 365,FL5,Zi. 

49S5 REURITEFILE USING S4,FL5,Yi 

4965 GOTO 4915 

4975 __ 

4905 CHnZll 'EDO' ,3 
499D CHAIN ' E13D ' ,2 
4995 REM 

5000 URITEFILE USING 5 0 05 , FL5 , ' Pr e EXECUTE to proceed' 

5005 FORM Pd54H9 , C3b , PLiS479 

5010 RLAUFl'LE USING 5035,FL5,.Qi 

5(115 FnRH.P0S479,C 

502fl FOR__I-t TO 16 

5025 P23NT- 

5n3D NEXT X- -- 

5.1.15 TF H(J)='J CDTU 5125 
5120 GOTO M 165 
5125 Jl".-CHj7< J> 

5j5b RCUliUtilr JLfc' USlN(3 5155 , FL5 , ' D b you u^nt to rerate',Pj; 
5155 FOrH PG^:65, C2] , X, C3b 

51-60 l^i.'^^-Z'ZFl'. E USING 5165, PL^^i ' o n riimt-nsion J^>,')" 
5 J 65 FOP^' ?r5129.C15., C2, CI, POS_150 
:Ji7a RE^rj-::.^ a5INC_5t75,Ft5,Cqi' 
5; 7r, FC:^ ' - T " C3D - - - - 

tr.^ii r-;^:. . ■ .tsiNG 2360,fl5,Yt 

11-5 IF -■ " r JTP 1 J oS 

"^^r. I- -J . '--^^ Gcrd iB35 

r-r- ^: "T- Using 365,fls,z* 
.-r:c- p^^'^i'Z-z^t USING 5:^0 5,rLS, yi> 

z:r: -::ii?.c63 , • . : 

= *+^i?-^._CHAINING. FPQrl FTLOG hh* >t«-H* +f ♦♦♦Orx *t 

u!^:te~:::e using 5225. p::5, None- 

LJj5 r^' -T-j. 1,C5 

525n 0 

5295 L-C-T'j IZ? 

53iiU RHr! ^ >vif > cHri^iilNG M-iOM FTLDG k k h** k v> 

5305 URiTl^FTLE Usirn3 5225, FL5 , ' N on e ' ■ - 

53/p Gai(:_22p. _ 

:>37_5 RE^j '-K*- ^^^^.^^^t' 

53B0 REri ^♦♦f^^Mi' ^r. Sd&RDUTlNE...*» f***'^^* ^^t^*****^***** 

5385 L'Erl RmNHOM rniAI> GENCRATDR «H**»H» 

5390 G( 1 )-^XNT(Nl-r:Mti+l ) 

5"^V5 n C 2 J * j in ( N .i * pi JIi » 1 > 

b^iOU IF G(1)^G(2) GOrd 5395 
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54 0 5 
54^ 0 
54 IS 
5420 
5425 
5426 
5427 
542? 
543D 
5431 
5432 
5433 
5435 
5437 
5440 
5445 
5450 
5455 
5460 
54 65 
5470 
54 75 
5480 
5481 
54Q2 
5483 
5490 

s^oo 

5505 
5990 

5^99 
6000 

£::03 

i JCI4 



G(3)-INT(Ni**RNLj4l)-- - - 
IF^e(l)-G(3) GOTO 5'105 
ir:_G<.2) = G<:3) goto 5405, 

5Ih ^^*^--FILE data 
Wm Tile nuhber for pata?^; 

INPUT S2 

a3=s2ti ; 

34=53+1 
S5=S4-Hl _ .. 
QRITEFILE FLr> 

OPEN -Fti . :ebp - -, 

PUT FLl , Ti, S*. P* . J.Nl 

§pifF[2!-EBO^.S3.'F2 .0UT.IOF.RR 5990 
MAT PUT FL2,S?.B*.C» 

§^^^'F[K'EBa',S4.:F3^ ^^^y 
HAl HOT FL3,l!,5,t<,U.U.L,Y 
CLOSE -Ft:3 



, 'F 



52. *F1 • .ODT..IOERR 5990 
" N2,K2 



F4 • . OUT , RECL=320 d , SEQ . lOERR 



OP^H Flt:E EL4, .'E80* ,! 
UIPITEFILE Ei;.4,Mr.TZ 
WRITEFiLG: FL4.MATK 
URITEFILE FUM.HATR 
CLOSfi FILE FL4 

^RIN^ ^RLhAKEiiLE5P.CE Anui^PL 4790- ' 

1^°^........ REAL HATA F ROM-- FILt^^^. . ^..^^ 

pIxNT 'FlLr NUMBER FOR DAlA?"; 
INr^U I 
S3=B2- 1 
S4 = S3-".. 



5990 



Gu5Cr<. 



c "-0 
- ^ 5 

6 ' i 5 5 
6056 
6057 
6050 
6 U 6 0 
607 0 

'6oeo 

6l»-^0 
610(1 
612(1 
6130 



'■T:^n-.S2.*F1-,-IN.10ERR- 6990 

-Jz' ,s:^, ■r2- .IrMOrRR 6990 

r^- '*"?L-2; A^ ! ,C:i 

"/-^•Elj^a' .y4.-'-F3'.]N JdERK 6990 
t,^I Gc.- =^L3,H.S,r.P.a.L,Y 
l^l:^fr^U FL4,-EBn-.G5-rM-:iN,I0CRR 69.0 
REAPFIcE r-L4,hAT2 
Rt Ai'!- }LH: FL4,r!ATX 

REhDFILF- rLU..hATR 

ir;puT 0 • 

IK-'Cli- NU- uUilJ I. Mill 
PR i NT 
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61M-0 

6150 

6990 

6995 

7(f'B0 

7690 

7692 

7695 

7700 

7705 

771 b 

7715 

7900 

7910 

7915 

7920 

7925 

793D 

7935 

7937 

79«+0 

79M5 

7950 

7955 

7960 

7965 

7970 

on bu 

jyO 05 
8010 
fJU20 
8 0 25 
?:27U 
■ ^'75 



ALTERNATIVES 



; It-, 



) •,A$(I) 



NUMERIC INPUT IS IN RANGE 



GOTO 6070 _ . 
CHAIN ' EQD ' ^2 

PRINT -PAD FICE; ; t ABANDONED' 

S70P - 

rEH : uDRUUTINE+t#*tK»:iISPLAY 

FOR 1=1 TU Nl 
I«t=CH.R( I ) 
P=P+6H 

RfORTTEFlLE. USING 7705, FL5, ' ( 
FORM POSP;C2;C1.C3,C30 

m>i^^ 1 

RETURN 

KEh «^*(^*^iBUSRDUTlNEM^M»*M_ CHECK 
READFILE USINC5 7915,FL5,Ct. 
FORh POSPl , C 
I^NUHCCi) 
IE I:=N1..G0T0 7935 
IF I>0 GOTO 797,0' 

p 77 p > 

Ii = CHR(Ml) - --- . 

Qai='Plea5e type a aumb er . b e t u'e on 1 and 

REtJRlTEFlLE USING 795 0 , FL5 ; . I^' 

FORh PbSP,C36.Cl ,PD5P1 - 

READFILE Using 7960,FL5,Ci 

EQRh POSPl , C . 

GOTD--7920 

RLM^S^^*^ i^SUP^O!JTlNC»--H»:x^^*^CLEAR SCREENtr>>^>>K*. 

FdR I-i TC 16 

PRINT 

NEXT I 

REh"^-'»^---^SUBROUTIrJE>^M^*r^rtf CHANGE HPiJ lUGS^^^^^^^^^^^^^ 
REU=::T=:7ILE.USINR_ 51 ,FL5. -Vbu can* 



■ G 



r-iEDPi" 

REwr.:; 
I r 

F: £ ^ " : ■ 



( 1 ) Cijrico I i 
■ I-E _ USING. 53^ FL5_,.Q^'. 

_( . 2 ) ...Channe. youv 
"TLE- USING 5iKFL5,Qt' 

,:.:.rD 83io- 

< 3 > Chande-the 

-_:-^t Using S5.fl5,q^ 

uould you like to do?' 
":^E USING 57.FL5,Q^ 
:3TQ 833U_ 

type in 1, 2, or 



scale (arid all ratinos on it 



ratings on 



th is sea U 



position ot the ideal value' 



1^34 0 

ft3M5 

C350, 

8355 

0360 

E1365 

8'i67 

8370 

fc!^75 

B377 



r ■ .... Pi^^asc .typ.e. in. 1.^ or 
-'-ITE'ILE USING. 83'+.0 ,FL5, Q1> 
F i- r-. . 1 ' 5 1 3 . G3 0 . P 0 " 511'+ _ - - 
READFXLE UiSlfiG B35D,FL5.Q^* 
FOFirl P0354^,CJ.O 
IF - • 1 • GOTO 8390 
IE O'l'-' •3* GOTO 8390 
IF >:L2 •.6P1 = 0 GOTO 839 0 

GDSUl^ 8000 - 

IF i ' GOTO 03Cn 

n(.U=--29V 

GOTO 1195 - : 

IF 0't = '?' GOTO 



197: 



75 



> 



B?A'^' GOTO 2'j.'^0 

ir/.^'U Ri:uL:j]L.r.]LF.:..u:-;iNG Y.9,rL5,Yi. 

y;. ^' u mu^^t choose one ut 1, 2, or 3 

U/.y? GOT U . - - ^ . 

Qi.= • 10U must :.tT Qooe _ £* i i h e r 1 or 

UHUC; RCURIT: USING 6i,FL5,Q$ 

84 1 n G01 0 B.^..'U _ - - " 

Be^,a REifi. **t*^*'*^**suiinauT i ne:^»>**-h>:M splay .j-schle:^ r>.k^*'>f 

8L;n5 REURITPTILE. USIfvG 68 , F L5 , F^'f ( J ) 
Bvun FOR 1=3 tG ? 

095 0 3 5> = r:flR (I) 

89 1':. IF 1/t, GOTO B93U _ _ . 

n9;'n RLUI-:iTt:F]LE UGJNG G93^^,Fi.:S. ^ to 

892>"' GCJlO B9U0 

e9::^{i nLURn.uri.LR: .uGifiG ^9Z':> .ri.^ , u 

B9:i0 FDRL-1 po!^r,c:^o 

£i9un NC>^1 I 

P9M-IJ P- KiM- - - - -- - 

t.i9L.(.i RilUPTTLFiLK Cl^.lriC 093:j , FLl- , C'J- ( J > 

HVL'L. F<i:UM-'N 

VVV9 S1UP 



eClO REM - • 

0020 CCM llftH COP t4tJM CHAIN] fJG UIIH COMMON USb! AREA 

0 030 RCM _ . . ' _ . ... 

(lUttU UIJC 1 ^.i^»0 . 5^7.0 , Pi.30 . 

d 0/.>d UbL C , J, Ni , N:' , K2 , 51 - 

0070 UCUi A^j>oO ( 20 ) p:^i(f.n ( ?n ) , Ct.60 ( 20 ) 

bu{30 Lisr: z <2b , 2d ) , x f 2d , 20 ) , R< 20 , 2D > 

OOVU' Ul;r H(20 ) , 5(20 ) , :M0 ,U<2d ) ,U<20 > , L(2U ) , Y(20 ) 

0 10 0 El 1 M ( j 6 d , X '4 6 0 < 3 ) , S' i 6 0 , 2 i 6 d 

Olio r-lS F.(.20 ) , G( 20 > 

0150 REM;. 

Ol^OYI— 

017U Z%-'P[9Ciso -typp YE:5 or. ho' 

0 1 80 XI.--" * 

0 190 RTfi 

02J0 rH]N7 flip 

():'20 i'f-^lNl F L [' , * ■t' S^U^lnARY FOR ''.I'i'-.'f 

Q'VM} r\ l\-lJ TLP 

0240 P)-}Ni rLP.,.x:-;i'4';..' unler coNGiDrrRHT iun : 

o:j<'.o if. r:i • ] DDTD.2120 

(i2:io I UK r = 1 - TO rn 

0300 ii -CMr:( 1 ) - 

GI.1 d y*\n \n i'LP, xt-; * ( * ; i ^: ; * ) ' ; A'!- ( i )' 

0320 IF U( 1 ) •:- . fi COtn 

0330 Plriril f^LP, ' I'RFf-r:!: VALUF • ' ; 
03'Jd Hf^lNJ. .UijTMG 313n,r (I) 
U^-il^O ."..Kit.. ftrSi. 
0 36(1 1-RItJ'l f .^^' 
03/u PiMNl -FLP 

n3>:u rJi->'i I- - 

ivj'y{\ p f\ J' - . - 

o^uw Hi'] ^1 Flp , x> ; ■ m"' i'lM I'MTl: \n.v\i'j' ;on3 ci'"ri' 

: ^ ! 0 :^ ; : - - i.P 

. u2ft T" . : ~:.T0 2.i':i.i 



•u J 



- P , X : ' ( ; ; M c ; • > • , i; i <■ r i) ; ' < 1 ) T u . 

-i-\o r.ti~n i20.. 

' (soTfj /.no 



( 1. f hi-(JO I fiN c^.ticF .urn DFCAur:!-: or sim.ilarjiv 

!JT*Tf; LUhLi^SU'iN ' , HI ; ' ) ' 



u;.. ■ p . , ^ • c i-r ,1 1 nr^r. iMcr.nPLti'fr : ruhiiNyiUN camcl^lfii » • 

(iLnih L>:it . - - - - -- - - - 

nti^VO Ri'J'- PLF','(Nri gY,r:jt-.NCF IN t'Ri ••FRLNCi: U"IiIiRING GN l!!;' 

O/^O'.i Pi^'J.j. PLP . ' lahLNM u/x') ' 

0/ Ml • G(t1 L 

(1620 PKTr'l FLP,.' CRMMNL3._Cr. I.LLH ON THIS SCALr: ) ' 
D<'.30 If H li ) ■ -2'J U C'G'f IJ 630 

Of'iio Pi'-r.'T pt.i' , ( H^i^p irvif.'f. 'iTi ri.Trii inPAP Pt,— ^ ) ' 
u^su ii- H ■ ) 1 ; p^i 2 ill 

d^AH IP M n ' 2 . C J i '1 71 n __ 

C670 I';-]''. riP,>::;' f:LI.,r,TJVL ] i , I ■O i M nMC: ■ =^ ' ; 
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P6S^J PRINT UGlrvC 3:.0,FLP,UCh> 

0 69 0 PRiNt FLF' 

07::(! HKTNT FL[', ' inronrLETi:; > ' 

07iU ['illl.JT.TLF : 

074 u birr.xi M . 

LiVM' BHINT FLP 

077U- PRINT Ftp, 'KraiNOS Oi- .V^i'. ATT..liLiL 
fj7Bir PRirn ELP . _ ^ . 

001 b PRINT FLP , r.TI.< ( 5 v , 1 , 9 > ; 1 AI^ ( 1 0 > : 
08:^:0 FOR 1 = 1 TO Nl 

0830 : .MilUM " " . 

0£J!:.0 NFXT.I 

OHtn PiHNT FLP 

ot;7(i iMUNi ri.p. :ATiRiPUTb:' 

tlUWli PKINI f LP, • I'J ni.fJ'..iUN 
OH^>'i\ FOR :) 

091 u v^^^f.T FLP. • ( • ;r5--; > 
» v^'O FOR i-1 TO rn 

VMIJ PKliH .Ub^rJO 9-J.0.rLP,/< 1 ,^^> ' 

u9:jn r.!E>:T.i ' 

UV4i! PHli'l TLP 

0970 IF |-l«:M>--9fi FCi^.U.llUl 

OVVO PI'lf-JT FLP, • VALIU. ' ; 

i u ^ ii F UP 1 ^ i _'i i-"* - 

iGiu piM!;'- usiMfT v:^ri ,KLP, >:( i ;^'> : 



1 (Ui t» 



0 G(.'Tii n'^i' 
Pi-:,.- :-LP, 



; ' ) ' 

• pV>i ifJ':.G irJ!.:nMi-L(:i L : LriiiCliLLr io ' 
T rruU 1,14 0.- - - , 

.,;(, vAPinrT! JM PPrrLPlMri. Ol.I'r:- 
( 1.;m1 1N(. Lo^'^ i-LLFi;) ' 



117 0 n . 1 ! • 

1 i;.f t-: - 

1 711 0 Pi J ■ n.r^ 

\[^, h! V^.!iiuMM Jr i'^ 1: f-^^'^' 

: ?-M t u I - - - 

1 -'C.M 1 1 - T . * 1 

IV.-; I,, in-] 

i I.' t ' - ■ ' 



C.I t ? 



12[>-J :H IX <2 GOTO 1590 

i:5lO PHINI FLP 

ly^ii PHiNT FLP, :cuR;v::in. rRrrKKEN:-::.DKr'rr:if;G .(.from vLgt.to; 

I3?0 PfilNf FTP , • UOPST ; P::i:i-El?t:i.C:^ Vr.LtlEIG are GIVT-N TN riRATIXTS ) • 

K^'i (1 1 ::^] 1-1 . . _ _ 

1 h Ul; TC 12 

1'4^-} 1-1:5 

1770 FOR iS=l TD 

l7/: d IF F ( _F< 16) GOTO li^6b 

ifil mvG< 16) _ .. . 

im::o f ( 16 )^f (I5> 

1430 G ( 16 )^nc j 

1^40 F(IS)=L3 

J ur,o G ' ir^) = Lif 

r4 6h NFXT 15 
1 4 7 0 : .••'"113 
1 T I' f P 

1 ■ HiM w [ ■ i.P . .".DK^T ' 

ir-ii ! 1 .•■ . ; TO n 

It ^ ' s) 

: 'oo i' !■ I i 1 1 r ij' , r.t ( > ; 

] t'f n ; ( W , fj;} ) 

iL^'^ti PHirn UGifJCi 1 (1 , i LP . r c i ?; ^ 

Ki/.(> NT?:: i:^ 

1 1^. "'0 PI:: 'I FLP , • ULiI'C I 

• 1 ii D.VK.r I i i,-f: f l .:• . . •. n o i' • ., all. . . . 

j^nn up; T'lT J LF_. U:jf-^G l (r.i.O ,.fXb , 'V. f--. LXi nUL' to r-ro. red- 

1 J 0 LDl'Li - PT'S^.N.? , c:5o . PDr>U Vv. ._ 

j/:^f' PL''.''*"liX L'LMNfj , ! L'j, (31. 

1 ^::u f- 1 ' 7^ , L 



: ^ ^ u 



Z." : L,F. Ur>.i NC. 3 ^ , r L!' , ' :iu you i.i.VifM U. sir 1 tu 



" :"" I'ly _l:^ 1 r^r. 170n,FL::., cori- 'm^io:. h.-tL-.-^n 



_ i^L Li:^] f^(.. i 74 0 , f u, 



r I* i' V r e n l c 



V i dua i i 1 1 I ii : 



0 V d (■ i 



I ^ — . r ■ ..Gn:ro ?o-., .' 



p;_' '!:.! lP J ll ul: : r;-,: . r 

C Ci I 0 3 710 




i: 

1 L::t. 



p iM 1 . r r 1 . p 




1 h 



f) 



190 0 PRINT FLP. •(' IM?-; > 

1910 FUH 1=1 TO H-1 

1920 IF H( I X .5 GOra 19M 0 

19.7>\[ pi' I NT LISING 93() , f-LP , i\U , M) ; 

IVMO NIT XT I 

IVbU fMO.Nl_Fl.P 

1 /60 tJ: -^^T h 

1 970 PNTNi Fue., • . . ' ; 

l9r-iD FDR -I - 1 TO J-J 

199D IF HC I )< GOTO 2 0 2 0 

2 0 (i 0 : ( « H 5 _ _ ._ 
20 to" PRINT USING :'DDn,FLP,l; 
2020 NEXT I 

2030 PRINT FLP 

20^0 PRINT FLP 

20^0 PRINT FLP.' iUlit END GF SlJfiHARY 

20 to PRINT FLP 

2HjO C^l - 

2 J 1 0 uiiAiN • enti ■ ; i 

2120 C^-2 

2i:^o c^^raN 'VUb' i 

2 3 4 0 c ^- :^ 

2KjO chain ' i:: ^ , 3 

2160 ST UP 



00 10 tLh 
EF.fi 
no 30 RKM 
ODMH USL 

ust: 



fii 
bu 
no 



Id 

■)■() 

0 [J ^ [1 
010 0 

alio 

0290 
0300 

d:^l b 



3 0 

0 

C 0 

:i :<7 0 
OTMjn 
b > M 
n 0 
in 
Q ij :^ (! 

till M 0 
0'^ 



UUW PRLT tIJJil CH.'.INING UITH COhifiON UTiF. ARF.A 
i' 2D ) . K'j ii UM) ) , Ci>60 (20 ) 

z c 0 . 2 n ) , X ^ u , 2 d ) , FM 2 b , 2 d ) 

H(2U ) , S ' 20 ) , r!(2U ) ,U< 2b ) , U< 2b ) , L < 20 ; , Y (20 ) 
r::..^0 '<i.oO -/r'p6 0iZ5i6 0,M5.192,N'ra?2/v^'i'l??,Ri] V2,U''^^ 
N.(2 0.; T ( 2 0 > , V ( 20 ) . H ( 2 0 ) , C)< 20 , 2 0 ) 
F1I;E Ft:5 , • 0 0:^ ' , ALII 



Liiti 
OPFN 

pr,.j 

Yi- ' 

Z-T^--- ' P I e.ir.e type YES 
Uhitffile using 32b, FL 

ru.'^h POS^'iU? , C3b , Pd3i|79 
RFr.riFJLE USING 360, FL. 5 
r-l.UR] IFF JLE USING 3iO 

FDi.'ri ra::';ii.?, C62. 
FUl'fi pasy-72 , r30 ._. .. 
r-riJ[':i tlfile 

Fnf:H POSoL'^t 
ui'Hefjlf 

F UP.'t f'(1R95_, C30 
RFU'-'l TFF ILE USING 
FOPri Pl)>129 , C1'~'_,_X 

RFUi' J rrriLiL 
raiiii . pf'Si.93 
Rt HIM Ti:r Hie 
Fi'i-'rt i'0:r:rr> 

Rr i^iIiP J LE USING 
Fn:-.i POSr'Sn.CfS 



NG ■ 

P y L- 



EXFCljlE i. 



■ (j C t' C' ci " 



, pu: 



5 , 0-^ 



; FL^ 



M LU , FL^ 



, FL^ 
, FLG 



' U (I u t d you I i h 



i\ M' various 



\ 0 



y oil I i 



^2 

UGlNG.iJ'lU., 

02!; . Ru^;r'.i8. 

, Fi:C) , ui' 



1 0 ci 



i b c \hv 



' e q u .-^ M y 



D'llf-r, 



.n ,fc^' . Y^. 



(J y I! <: ti ^- - ' 

:i y.M) 1 :.;)-! 

1: V I ■ ■ : ^ 

(I , ■ • :j ' j' ' ^ ) 



U737 NEXt i 

0740 ir k2>(6 Gdtd 78U 

07t:U FDR_I=i TO Sa 
0Z60 U<J>=1 

U770 NEXT 1_ 

07Bn FUU H^l TO. ai 

0790 FOR I-I- TO N.l 

bOOU IF X(1',M)>:99 CiOTO B?!) 

0810 NEXT I 

0820 T<h)=l 

0830 T1 = Z< I - 

QB40 FOR I 0 N.1 

OBr,U IF. i .. r; ^ < . 01 Gd1 0 37D 

0860 NEX: J 

087U y <M)- i'. 

POCJO rUM)=7( I ,M>-13 

'.OVO i/ XT M j-z i w - 

U'/lO Rl'M FlNi'i NFXT PRC"! ^ 

(iom: if N:i^:2_ccld :?U7n 
ovoij p iJ^^ H-? to J 

0970 IF H(h><..rr CPU- ipco 

098') rr- H(M) ^ ' -GOIG 3 OHO 

09''0 FUH 1^-1 TO 

1 000 IF .S GOTD-I070- 

1(110 IF H(I>^2.^ CtlTO 1070 

1 0?n R1 I . M ) 

ID3(! .IF R3 --R^ GDIO 1 D70 

10 '10 Ml^^h 

inr-o M?=i . 

1 [!/;n n:- r: . 

in M! hi:.- 7 1 

] h 0 1 1 i J L '. r- 

. r. o p H ■ 

liOO Li.^- 

: : 1 L L?^-- • 



i 1 /: " r« : - . ^ : 

I w ^ M" ^. • I 

I I ,'•[; u:--- 

1 1 t:. r, 11 1 - 1 "I o [.: 



1 2 0 n 


G2=V ( r2 ) 




i r> 0 -; 


NEXT I 




.' 


RLM PRlNi fJrIJUNb 






M - V i' 




1212' 


N 'l- = Y 9. 
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